Ответ:

The action was in progress at a specific time in the past, so we use the Past Continuous: were having.

We were having dinner at 7 o’clock.