The death toll from a migrant boat disaster off Yemen has climbed to 96, underscoring the growing human cost of perilous journeys across the Red Sea.