Reasoning: The phrase "It's so late" implies an urgent necessity or obligation to leave. "Must" is used to express strong necessity or obligation.
Answer: must