More often than not, there are surprises to be had when climbing. Climb up buildings, structures, mountains, pillars, and everything that's climbable. Most of the time you'll be rewarded with a chest which helps increase your Adventure Rank, so do it!