The couple left strategic points unguarded, and the enemy could take control