Jacopo Razzauti
@jacoporazzauti.bsky.social
PhD student at the Rockefeller University
🐜 Emergent collective behavior
Finally, with @tomaskay.bsky.social we asked whether FERAL can detect collective dynamics directly from raw frames.
We annotated raiding phases in colonies of ants.
FERAL identifies the onset and duration of colony raids and collective behavior without tracking!
Finally, with @tomaskay.bsky.social we asked whether FERAL can detect collective dynamics directly from raw frames.
We annotated raiding phases in colonies of ants.
FERAL identifies the onset and duration of colony raids and collective behavior without tracking!
November 19, 2025 at 6:30 PM
🐜 Emergent collective behavior
Finally, with @tomaskay.bsky.social we asked whether FERAL can detect collective dynamics directly from raw frames.
We annotated raiding phases in colonies of ants.
FERAL identifies the onset and duration of colony raids and collective behavior without tracking!
Finally, with @tomaskay.bsky.social we asked whether FERAL can detect collective dynamics directly from raw frames.
We annotated raiding phases in colonies of ants.
FERAL identifies the onset and duration of colony raids and collective behavior without tracking!
🦍 Camera-trap footage of chimpanzees & gorillas (PanAf500)
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
November 19, 2025 at 6:30 PM
🦍 Camera-trap footage of chimpanzees & gorillas (PanAf500)
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
We pushed FERAL to handle multi-species, multi-behavior field recordings: day and night, dense vegetation, variable lighting.
FERAL achieves strong accuracy even for visually rare but distinct behaviors like climbing up/down.
FERAL goes wild:
🦓 Drone footage of Grevy’s zebras (with @blaircostelloe.bsky.social, Ben Koger and @icouzin.bsky.social)
Pose-estimation pipelines struggled to detect vigilance behavior from overhead drone videos.
FERAL identifies vigilance bouts directly from video.
🦓 Drone footage of Grevy’s zebras (with @blaircostelloe.bsky.social, Ben Koger and @icouzin.bsky.social)
Pose-estimation pipelines struggled to detect vigilance behavior from overhead drone videos.
FERAL identifies vigilance bouts directly from video.
November 19, 2025 at 6:30 PM
FERAL goes wild:
🦓 Drone footage of Grevy’s zebras (with @blaircostelloe.bsky.social, Ben Koger and @icouzin.bsky.social)
Pose-estimation pipelines struggled to detect vigilance behavior from overhead drone videos.
FERAL identifies vigilance bouts directly from video.
🦓 Drone footage of Grevy’s zebras (with @blaircostelloe.bsky.social, Ben Koger and @icouzin.bsky.social)
Pose-estimation pipelines struggled to detect vigilance behavior from overhead drone videos.
FERAL identifies vigilance bouts directly from video.
Ant social interactions (with Janet Zhao & Dominic Frank)
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
November 19, 2025 at 6:30 PM
Ant social interactions (with Janet Zhao & Dominic Frank)
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
Next we wanted to try FERAL on recordings of social behavior. FERAL detects both self-grooming and allogrooming directly from raw video, even with occlusions and two animals with very different shapes.
How does FERAL perform on lab recordings?
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
November 19, 2025 at 6:30 PM
How does FERAL perform on lab recordings?
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
🪱 C. elegans locomotion (with Friederike Buck)
FERAL incorporates temporal dynamics in its learning. In this dataset, it separates forward and reverse crawling: behaviors that look nearly identical frame-to-frame, but are revealed by temporal dynamics!
Performance
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
November 19, 2025 at 6:30 PM
Performance
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
On benchmarks, FERAL beats both pose- and video-based baselines: 94.5% mAP on CalMS21 (mouse social interactions). Outperforms Google’s VideoPrism while using only 25% of the data.
Here’s a snippet of FERAL segmenting mouse social behavior:
As you can see in this pic we practiced this presentation a lot and we also have some FERAL tshirts! #getferalatSfN
November 17, 2025 at 8:14 AM
As you can see in this pic we practiced this presentation a lot and we also have some FERAL tshirts! #getferalatSfN
#SfN25 Monday morning we present FERAL: a video-understanding tool for animal behavior detection without the need for tracking or pose estimation! FERAL detects single animal, social and collective behavior in the lab and the wild! Visit our poster at board ZZ5 and check more here: www.getferal.ai
November 17, 2025 at 8:11 AM
#SfN25 Monday morning we present FERAL: a video-understanding tool for animal behavior detection without the need for tracking or pose estimation! FERAL detects single animal, social and collective behavior in the lab and the wild! Visit our poster at board ZZ5 and check more here: www.getferal.ai
The Rockefeller Uni ducklings are back!
May 19, 2025 at 1:47 AM
The Rockefeller Uni ducklings are back!
Goldfinch in Central Park
April 17, 2025 at 12:30 AM
Goldfinch in Central Park
Golden-crowned kinglet in Central Park (by Turtle Pond)
April 9, 2025 at 1:20 AM
Golden-crowned kinglet in Central Park (by Turtle Pond)