Does it annoy you? If so have you tried experimenting with no SM in the DSU? The SM isn't required for the DSU beyond team coaching (15 mins and address the Sprint Goal) so why they feel the need to take such a proactive role is beyond me.

Respect is a Scrum value.

The SM should work with the devs and the stakeholders to explore why non dev team members feel they need to attend and what other options are available that could fulfil their needs.

SM is responsible for implementing Scrum according to the Scrum Guide which is clear in its instruction for the DSU.
1) For the Developers to inspect progress to the Sprint Goal and adapt accordingly.
2) 15 mins maximum in the same time and place.
3) Format selected by the developers.

It feels like the main sticking point with DSU for many is that the true meaning of the event is not understood. Trying to find Agile accounts to follow in recent days I see that many complaints come from interference from outside the Dev team, including from SM and PO. Fixing it falls to the SM.

Hopefully you'll have a retrospective to raise this in and resolve it for future projects.

The SM should enforce that, not dilute it. Remember only the Dev team are required at the Daily Scrum so the needs of SM, PO and stakeholders are secondary and you need to work out a method of obtaining any input you require from them that doesn't disrupt the same time, same place ethos.

that's a huge red flag and makes me think your Scrum implementation is doomed to fail. Scrum Guide says "The Daily Scrum is a 15-minute event for the Developers of the Scrum Team. To reduce complexity, it is
held at the same time and place every working day of the Sprint."