CONTAINS SPOILERS

Early on, you'll notice that you take damage when you jump into deep pools of water. This is because it requires an equipment upgrade available later in the game. In order to swim underwater safely, you'll need to acquire the Hadal Ballasts. This is only available after you've cleared the 5th Biome (Fractured Wastes).