I finally got a new card and realized how bad optimized everything in this game is. Probably avatars mainly.
I can't pull more than 40 fps in pypy with 35 nip booth avatars. My vram goes to almost full capacity while the GPU load is around 30-40% at most.

Still need to test more Oculus Link configurations, as of now I can't find the difference at all.