So, I tried out the IKTweak mod, and it's pretty damn good. Viewball drift is eliminated in my case.
Still I experienced some issues that made my movment when not lying down look fucking retarded.
Will probably only use it when I lie down in the future, as it excels at that.
You should give it a try.