The sentence refers to an inability to stay longer because of the heat. 'Couldn't' is the correct choice to express this past inability.