Here's the situation: it's possible that, after you long-rest multiple times in Act 3, vampire spawn will ambush your camp with the hope of returning Astarion to his sadistic master Cazador.