Используем формулу cos²α = (1 + cos(2α))/2.
cos²(15π/8) = (1 + cos(15π/4))/2.
cos(15π/4) = cos(4π - π/4) = cos(-π/4) = cos(π/4) = √2/2.
cos²(15π/8) = (1 + √2/2)/2 = (2 + √2)/4.
√72 * (2 + √2)/4 - √18 = 6√2 * (2 + √2)/4 - 3√2 = 3√2 * (2 + √2)/2 - 3√2 = (6√2 + 6)/2 - 3√2 = 3√2 + 3 - 3√2 = 3.