I keep losing my usb c to headphone jack, but I usually use it a couple times a week when its not lost. I have airpods, but I'm on android so I lost the charger for it, and nearly lost the airpods many times.
Do you have issues with keeping track of things like that in general? There are adapter keychains you can use to keep any on your keys. Or I've found having a specific place for things helps me, I used to lose my usb-c adapter but now I just always put it in the same spot when I am done using it.