Great work led by Josef Grün & Lukas Meyer and with @maxweiherer.bsky.social, @visionbernie.bsky.social, @mcstammi.bsky.social and @linusfranke.bsky.social!

To explore this, we systematically compare three strategies for incorporating multi-spectral data into 3DGS and show how spectral cross-talk (the exchange of information between RGB and multi-spectral data) enhances both RGB and spectral reconstructions.

While 3DGS excels on RGB data, naive per-band optimization of additional spectra yields poor reconstructions due to inconsistently appearing geometry in the spectral domain.

We fuse RGB and multi-spectral imagery (red, green, red-edge, near-infrared) into the 3D Gaussian Splatting (3DGS) framework.