>>324671410
Be sure to actually try posing the model in Blender first and correct weighting, I'd bet it'd be that. Good luck with weight painting. 
If you're convinced it's a rig issue, try moving the root of the shoulder bones further from the model's centreline. Kind of hacky but generally works alright for VRC IK. This will make your shoulder movement more subtle which would also help with your issue.