You can't switch between touch controls and a controller in game, you have to restart the game completely.

Please note that if you quit your game in the middle of a dungeon, your progress will not be saved and you will have to start the dungeon again.  We therefore advise you to do this when you're in the Bergsons' house!