I think their burrow is near the walkway behind our house so they see like 20+ people a day and that's why they don't get scared anymore

It got scared bc Pepper was jumping into our windows over and over to attack the rabbit