I have done it. I have made a window into vrchat. though it only works well in a single dimension. My math and coding skills are not enough to make it more believable. I would need to make a shader to warp the view to make it work better. Looks really good on the phone camera but in person it kinda sucks.