Not just because some of them are needed for the Community Center, either - at level 5 of the Fishing skill, you’re given an option to sell your fish for more money, and if you choose it, an upgraded version is available at level 10. Try to keep your highest quality fish until at least level 5 if you plan on going that route - you'll end up with a lot more bang for your buck.