The elite enemies receive less physical damage due to their armor. The key to beating this challenge, then, is the placement of mage towers. They should be placed next to barracks, as the ground soldiers hold the enemy in range of the mage towers. A dwarven bombard right at the start helps weaken the wave of attackers. See image for a successful placement of towers.