They're going living in the country.

Explanation: The verb 'living' needs to be in the 'to infinitive' form after 'going' to correctly form the present continuous tense.

Corrected sentence: They're going to live in the country.