If you enjoy this type of content subscribe to my newsletter where I share a lot of this stuff 😉
xraispotlight.substack.com

Launch FastVLM (huggingface.co/spaces/apple...) freely available on Hugging Face and set the OBS virtual camera as input

Start OBS and set up a virtual camera that will capture the casting window. Here is a tutorial on how to do it:
www.youtube.com/watch?v=fj-Z...

To set it up, cast the Meta Quest view on the web or using the Meta Quest Developer Hub (for a wider field of view using the cinematic mode):
horizon.meta.com/casting/

FastVLM, is a Vision language model 85x faster and 3.4x smaller than anything before. It can understand both visual and text, it runs in real time, has the potential to be run on device.
machinelearning.apple.com/research/fas...

I wrote a 19-page document with a comprehensive list of ALL WAYS in which you can get immersed in this type of photorealistic scenes on Quest or Vision Pro.

Just subscribe to my newsletter:
xraispotlight.substack.com

This is one of the updates, news and tech demos, hard to find anywhere else and included in my weekly roundup.
⚠️To make sure you receive this in your inbox join the waitlist here:
docs.google.com/forms/d/e/1F...

The tech demo in the video does an incredible job at visualising the differences between various models. Check it out yourself here:
www.360images.fr/3dgs/postsho...

I briefly discussed the different models for generating Gaussian Splatting (SPLAT3, MCMC and ADC) in my video comparing various 3DGS apps:
youtu.be/CrlSey4RmVI?...