If you find that you (literally) pushed your villager too far, you can use a "happy" emote like Joy or Delight to remove the sad purple swirls off their head.