Michael J. Black
banner
michael-j-black.bsky.social
Michael J. Black
@michael-j-black.bsky.social
Director, Max Planck Institute for Intelligent Systems; Chief Scientist Meshcapade; Speaker, Cyber Valley.
Building 3D humans.
https://ps.is.mpg.de/person/black
https://meshcapade.com/
https://scholar.google.com/citations?user=6NjbexEAAAAJ&hl=en&oi=ao
We iterate training CameraHMR and running CamSMPLify on the training set initialized with CameraHMR. This results in much improved pGT for 4DHumans and a SOTA single-image HMR method.
January 21, 2025 at 9:57 AM
4. But SMPLify only uses sparse 2D keypoints, which do not capture body shape. So we train a dense surface keypoint detector, DenseKP, on BEDLAM and run it on 4DHumans, resulting in improved body shape. The resulting method is CamSMPLify.
January 21, 2025 at 9:57 AM
2. We introduce CameraHMR, which integrates HumanFOV into HMR2.0 to exploit the estimated focal length.

3. To get accurate pseudo ground truth (pGT) training data, we compute the focal length for images in 4DHumans dataset and modify SMPLify to take this into account.
January 21, 2025 at 9:57 AM
There are 4 key contributions that make it so accurate and robust:

1. To get accurate 3D shape and pose as well as good alignment to image features, you need to know the focal length of the camera. To solve this, we train HumanFOV to compute the field of view.
January 21, 2025 at 9:57 AM
Code and data are now online for CameraHMR, our state-of-the-art parametric 3D human pose and shape (HPS) estimation method that will appear at hashtag#3DV2025.
github.com/pixelite1201...
January 21, 2025 at 9:57 AM