To send Bowser back into hiding and leave his Fury mode, grab a Cat Shine at a Lighthouse. It might be worth strategically leaving some Cat Shines around and not picking them up until he enters Fury so you don't have deal with all of the fire. The other ways are to grab a Giga Bell and defeat him temporarily or find a yellow warp pipe and enter it.