Jacopo Razzauti
@jacoporazzauti.bsky.social
PhD student at the Rockefeller University
🦍 Camera-trap footage of chimpanzees & gorillas (PanAf500)
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
November 19, 2025 at 6:30 PM
🦍 Camera-trap footage of chimpanzees & gorillas (PanAf500)
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
Ant social interactions (with Janet Zhao & Dominic Frank)
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
November 19, 2025 at 6:30 PM
Ant social interactions (with Janet Zhao & Dominic Frank)
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
How does FERAL perform on lab recordings?
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
November 19, 2025 at 6:30 PM
How does FERAL perform on lab recordings?
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
Performance
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
November 19, 2025 at 6:30 PM
Performance
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
#SfN25 Monday morning we present FERAL: a video-understanding tool for animal behavior detection without the need for tracking or pose estimation! FERAL detects single animal, social and collective behavior in the lab and the wild! Visit our poster at board ZZ5 and check more here: www.getferal.ai
November 17, 2025 at 8:11 AM
#SfN25 Monday morning we present FERAL: a video-understanding tool for animal behavior detection without the need for tracking or pose estimation! FERAL detects single animal, social and collective behavior in the lab and the wild! Visit our poster at board ZZ5 and check more here: www.getferal.ai