My goal is to be able to be able to bring the remote machine displays into VR and have control out of VR so I can have a team in VR run a physical event remotely. I know I can easily call an API from resonite and I can already control everything from HomeAssistant. However resonite requires a PC.

My knee-jerk is to make an OSC bridge between VR and the behringer mixer we have (it natively does OSC). I presume I can stream displays into VRC if we enable untrusted URLs for video? Currently I use immersedvr to a pc that remotes everything (giving me a virtual display for every remote machine).

I'm guessing it'd be possible to do a pixel (IIRC 1/4 of your 4k streams was a pixel thing) to control vmix (py to detect the pixel, then a vmix api). IIRC there's not a way to get your own video into VRC given domain whitelisting so getting a preview stream in wouldn't really work.

Ah, thanks for the explanation. I'd love to somehow run an IRL master control from VR. I'm trying to make a PoC, but it looks like I can't call a webhook from a VRC event? I could do OSC but I presume that'd have to be avatar instead of world? I'm guessing I'd need to use resonite to really do that

If you don't mind me asking, how did you connect all that together? I presume the video out (to vmix) is a desktop instance w/2x 4k spout streams. How did you get video (I.E. slides) into VRC? How did you get control to vmix (activate cam x to output y)?

"and viewers like you" - pbs

I actually upgraded from a quest 1 a couple weeks ago and the pass through is so different, idk why I didn't upgrade sooner lol