For which the code is also available github.com/naver/pow3r

Thanks Christian for the advertisement.

github link: github.com/naver/dune

🔗 Project Website: rayst3r.github.io
📄 arXiv: arxiv.org/abs/2506.05285
🚀 Code: github.com/Duisterhof/...
🤗 HF Demo: Coming (very) soon!

@CMU_Robotics @SCSatCMU @nvidia @NVIDIAAI @NVIDIARobotics

Big thanks to the awesome contributors to this project!👏 Jan Oberst, @bowenwen_me, @BirchfieldStan, @RamananDeva and @jeff_ichnowski. Also thanks to OctMAE author @s1wase, @nvidia for sponsoring compute 🖥️, and the scientists at @naverlabseurope for the inspiration! 🧗‍♂️

We also study the impact of the confidence threshold on reconstruction quality. Our ablations suggest setting a higher confidence threshold improves accuracy, while limiting completeness and edge-bleeding. Users can tune the threshold for application-specific requirements 🎛️.

We evaluate RaySt3R against the baselines on synthetic and real-world datasets. The results suggest RaySt3R achieves zero-shot generalization to the real world, and outperforms all baselines by up to 44% in 3D chamfer distance 🚀.

We train RaySt3R by curating a new dataset, for a total of 12 million views 📷 with Objaverse and GSO objects. The ablations 🔍 suggest that more and more diverse data improves RaySt3R's performance. RaySt3R does not require GT meshes, paving the way for training on real-world data.

💡 Our key insight is that 3D object shape completion can be recasted as a novel-view synthesis problem. RaySt3R takes a masked RGB-D image as input, and predicts depth maps and object masks for novel views. We query multiple views and merge the predictions into a consistent point cloud.

We focus on multi-object 3D shape completion for robotics. Robots are commonly equipped with a RGB-D camera 📷, but their measurements are noisy and incomplete.

Using only DINOv2 features 🦖 as pretraining, we train a new model (RaySt3R) to produce accurate geometry.

Do you think Europe will take the opportunity? The Netherlands is even cutting research funds under the new administration... It feels like there are still significantly more opportunities in the US.

Thanks Chris! This was a push with the entire dust3r team @naverlabseurope.bsky.social, congrats everyone!

😆

Is the book just as good/better than the show for "The 3 body problem"?

My advisor @jeff-ichnowski.bsky.social! For example: github.com/BerkeleyAuto...

For international students: renewing your visa asap might be a good idea.