Mastery challenges come as unlockable perks connected to the utilization of the many weapons and rites you have. They also give you rewards when particular conditions are met while completing the challenges. Each challenge has up to five tiers of perks, so try your best to get the "Level 5" as that should be a priority in progressing in the early game.