So I have an avatar with togglable clothes. For some reason very rarely I will appear completely naked to random people even though most see me with my clothes and I see myself with clothes. I can fix it by swapping the clothes on and off. 

What the fuck is causing this and how do I fix it?