When invaded by Mad Tongue Alberich, there's a way to get your runes back without fighting him. First retrieve your runes and sprint to the door to the right side of where he spawns. Die right next to that door. Respawn in Roundtable Hold, go straight past the Smith and down the stairs. You'll be able to retrieve lost runes through the door to the left. Now you can fast travel with runes in hand.