When you exit the Room of Three Switches, Baba's Cave is located to the far left, along the Banks of the Achromatopsia River. Keep walking left, it may appear as a dead end but in fact it leads to the area where Baba's Cave is located.