If you lock eyes with a Noise, destroy it
Like other JRPGs and regular RPGs, having more experience will make the game go by smoother while making later game bosses more of a challenge and less of a hopeless venture. The best way to do this is to fight as many Noise as possible. You can grind extra, by the bare minimum requirement should be to destroy at least everyone that appears before you.