Ответ:

In spite of searching all day, they didn't find the ancient ruins.

После in spite of используется герундий: searching.