Yes, the game does actually track how infamous you are, and if that number hits 100, you become known to all the world as a Pariah, causing other countries to turn against you and creating situations as serious as world wars. So… yeah. Try to keep that one low.