If there are Torii Gates available for you to cleanse, work on doing so as soon as possible. Not only does it unlock large parts of the map but you can also acquire valuable items from their locations. If you're working on having a complete list of collectables, it's crucial to unlock all areas of the map anyway. So you're better off getting this done sooner.