Решение:
$$ (6\sqrt{2}-\sqrt{26})(8\sqrt{2}+3\sqrt{26})-20\sqrt{13} = $$
$$ = 6\sqrt{2} \cdot 8\sqrt{2} + 6\sqrt{2} \cdot 3\sqrt{26} - \sqrt{26} \cdot 8\sqrt{2} - \sqrt{26} \cdot 3\sqrt{26} - 20\sqrt{13} = $$
$$ = 48 \cdot 2 + 18\sqrt{52} - 8\sqrt{52} - 3 \cdot 26 - 20\sqrt{13} = $$
$$ = 96 + 10\sqrt{52} - 78 - 20\sqrt{13} = $$
$$ = 18 + 10\sqrt{4 \cdot 13} - 20\sqrt{13} = $$
$$ = 18 + 10 \cdot 2\sqrt{13} - 20\sqrt{13} = $$
$$ = 18 + 20\sqrt{13} - 20\sqrt{13} = 18$$
Ответ: 18