So how exactly in unity do I "attach" an object to my avatar without that object becoming the new "focus point" for the armature? not sure how to word it.

Like right now if I select the head bone and rotate it in unity it rotates my head just fine. I have a hat that I drag and drop onto my head in the scene hierarchy and now it's attached to my mesh, but now when I rotate my head it's like rotating as if the hat is the "center" point. I just want the hat on and my head rotating like before