Rabbit hole lead to one of the tools someone is using or something... not sure.

My thing is what's the point of a robots.txt if it can be ignored