What version of the game are you playing? I know the American release makes more use of motion controls whereas the use of a Divine Instrument is mapped to a button press in the Japanese version. Also, if you know, how old is/are your remote(s) and do you struggle with motion control on other games? A couple of my remotes are no longer compatible with some of the Wii games I own because their ability to detect motion has deteriorated, but purchasing new remotes isn't all that expensive, and for this game, I HIGHLY recommend it.
Also, even though I know it's been a couple weeks since you posted this, if closing out of the game isn't too big a deal, I'd recommend doing that since 4 Winds took me a while as well for a similar reason. Sometimes it's a matter of swinging the remote just right, and other times it requires a new remote entirely. Regardless, I hope this doesn't hamper your ability to enjoy this game any! Good luck!