https://twitter.com/SalbugVR/status/1530365192797929473?s=20&t=jeUJojc71YVpEb3G0_EXqA

So turns out you can actually show a person's fallback when you hide their avatar by going to 
Select User > View Fallback Details > Expand details (top right corner)