Apparently you can move castle hearts, I didn't know this.

What are the things you want kept away from raiders aside from the obvious of chest full of important mats
Prisons and coffins I guess right
Refining stations too, so you don't need to always hide away your shit

Crafting and research stations tho, they can go near the front of the base right
Gardens too, only takes a few days for them to grow back anyway
Mob summoning pieces can be near the front