Matthias Niessner
niessner.bsky.social
Matthias Niessner
@niessner.bsky.social
Professor for Visual Computing & Artificial Intelligence @TU Munich
Co-Founder @synthesiaIO
Co-Founder @SpAItialAI

https://niessnerlab.org/publications.html
📢📢 𝐏𝐞𝐫𝐜𝐇𝐞𝐚𝐝: 𝐏𝐞𝐫𝐜𝐞𝐩𝐭𝐮𝐚𝐥 𝐇𝐞𝐚𝐝 𝐌𝐨𝐝𝐞𝐥 𝐟𝐨𝐫 𝐒𝐢𝐧𝐠𝐥𝐞-𝐈𝐦𝐚𝐠𝐞 𝟑𝐃 𝐇𝐞𝐚𝐝 𝐑𝐞𝐜𝐨𝐧𝐬𝐭𝐫𝐮𝐜𝐭𝐢𝐨𝐧 & 𝐄𝐝𝐢𝐭𝐢𝐧𝐠📢📢

PercHead reconstructs realistic 3D heads from a single image and enables disentangled 3D editing via geometric controls and style inputs from images or text.
November 5, 2025 at 11:37 AM
Can we use video diffusion to generate 3D scenes?

𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation.

Text input -> 3DGS scene output & interactive rendering!

🌍http://mschneider456.github.io/world-explorer/
📽️https://youtu.be/N6NJsNyiv6I
September 17, 2025 at 12:08 PM
ScaffoldAvatar: High-Fidelity Gaussian Avatars with Patch Expressions (#SIGGRAPH)

We reconstruct ultra-high fidelity photorealistic 3D avatars capable of generating realistic and high-quality animations including freckles and other fine facial details.

shivangi-aneja.github.io/projects/sca...
August 5, 2025 at 12:30 PM
📢 LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scans🏠✨

-> converts RGB-D scans into compact, realistic, and interactive 3D scenes — featuring high-quality meshes, PBR materials, and articulated objects.

📷https://youtu.be/ecK9m3LXg2c
🌍https://litereality.github.io
July 4, 2025 at 7:52 AM
In addition, we introduce a new OLAT dataset of human heads that features high-resolution and high frame rate multi-view recordings of diverse subjects in a calibrated light stage setting.

Great work by Jonathan Schmidt and Simon Giebenhain.
June 9, 2025 at 5:54 AM
📢BecomingLit: Relightable Gaussian Avatars with Hybrid Neural Shading📢

We propose a hybrid neural shading scheme for creating intrinsically decomposed 3DGS head avatars, that allow real-time relighting and animation.

🌍https://lnkd.in/evNt8bV2
📷https://lnkd.in/ekB5QeEK
June 9, 2025 at 5:54 AM
📢Code Release of Pixel3DMM 📢
Looking for a robust and accurate face tracker?

We handle challenging in-the-wild settings, such as extreme lighting conditions, fast movements, and occlusions.

👨‍💻https://lnkd.in/e3dX23WV
🌍https://lnkd.in/eQ3Zpn3J

Pixel3DMM can be run on videos and single images.
June 5, 2025 at 4:54 PM
📢PBR-SR: Mesh PBR Texture Super Resolution from 2D Image Priors📢

We propose a new optimization to up-sample textures of 3D assets (albedo, roughness, metallic, and normal maps) by leveraging 2D super-resolution models.

📝http://arxiv.org/abs/2506.02846
📽️https://youtu.be/eaM5S3Mt1RM
June 4, 2025 at 2:09 PM
📢GeomHair: Reconstruction of Hair Strands from Colorless 3D Scans📢

We reconstruct hair strands from colorless 3D scans by extracting orientation cues directly from the mesh surface geometry by finding local characteristic lines and from shaded renderings using a neural 2D line detector.
May 9, 2025 at 11:40 AM
📢Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstruction📢

-> highly accurate face reconstruction by training powerful VITs via surface normals & UV-coordinates estimation.

These cues from our 2D foundation model constrain the 3DMM parameters, achieving great accuracy.
May 2, 2025 at 8:33 AM
📢 LinPrim: Linear Primitives for Differentiable Volumetric Rendering 📢

We use octahedra or tetrahedra as explicit as volumetric building blocks for gradient-based novel view synthesis - as an alternative to 3D Gaussians with discrete, bounded geometry.

🌍 nicolasvonluetzow.github.io/LinPrim/
April 25, 2025 at 6:39 PM
📢 SHeaP: Self-Supervised Head Predictor Learned via 2D Gaussians 📢

Given a single input image, we predict accurate 3D head geometry, pose, and expression.

🌍 nlml.github.io/sheap/
🎥 youtu.be/vhXsZJWCBMA/

Great work by Liam Schoneveld, Davide Davoli, Jiapeng Tang
April 17, 2025 at 10:02 AM
📢Announcing our 3D head avatar benchmark📢

Two tasks with hidden test sets:
- Dynamic Novel View Synthesis on Heads
- Monocular FLAME-driven Head Avatar Reconstruction

Our goal is to make research on 3D head avatars more comparable and ultimately increase the realism of digital humans.
March 25, 2025 at 12:54 PM
📢Animating the Uncaptured 📢

We animate 3D humanoid meshes using video diffusion priors given a text prompt.

🎥https://youtu.be/_YL1J_V3smI
🌍https://marcb.pro/atu

Realistic motion generation for 3D characters - without motion capture! 🚀

Great work by Marc Benedí, @adai.bsky.social
March 21, 2025 at 10:54 AM
📢MeshPad: Interactive Sketch-Conditioned Artist-Designed Mesh Generation and Editing📢

Users can interactively design 3D models just from a sketch-based interface - check it out!

We break down the design process into addition with an autoregressive generator and deletion operations by a classifier.
March 19, 2025 at 6:58 PM
📢📢Want to build 𝟑𝐃 𝐅𝐨𝐮𝐧𝐝𝐚𝐭𝐢𝐨𝐧 𝐌𝐨𝐝𝐞𝐥𝐬? 📢📢

➡️We're looking for Diffusion/3D/ML/Infra engineers and scientists in Munich & London. Get in touch for details!

#3D #GenAI #spatialintelligence #foundationmodels
March 17, 2025 at 7:55 PM
📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢

Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model.

youtu.be/P3zNVx15gYs
tobias-kirschstein.github.io/avat3r

Great work by Tobias Kirschstein with J. Romero, A. Sevastopolsky, S. Saito.
February 28, 2025 at 9:33 AM