Another example of Gaussian Processes on a sphere is Mallasto's work. It's pretty simple: defining it in the tangent space followed by using the exponential map.
openaccess.thecvf.com/content_cvpr...

Timely read! I think the core premise is more relevant than ever, now that we're in the age of LLMs.