I have weird problems with my Rift S, when I take it off it disconnects after a second and I have to unplug the usb+replug it in and restart the oculus software to get it to work again, I have no problems when it's actually going so I feel like it's not a hardware problem, like a loose cable or something

I've tried reinstalling the Oculus software to no avail, what else can I try? I think my drivers and such are all up to date too