Wands require you to think a bit different. Neutral position is when you're not touching anything instead of when you kind of hold on to things neutrally.

Also I tended to think more in terms of facial expressions than hand expressions as sliding your fingers across the rim to combine expressions is pretty fast.

I bet you have mad face on fingerpoint as that's the easiest spot to touch. You may wanna swap them around a bit to get the most common ones in top half.