Many of the side quests have interesting story lines all their own. That alone should entice you, but of course you can gain xp and find unique items that you would never see otherwise.