Civilians have a fear meter that gradually increases by the ghosts making them more scared. If civilians get too scared, they will flee, and if too many flee you will fail a job. Go near them when panicking and press the action key to calm down the civilians before they flee.