Marcus Brubaker
@marcusabrubaker.bsky.social
Research Scientist@Google DeepMind
Assoc Prof@York University, Toronto
mbrubake.github.io
Research: Computer Vision and Machine Learning, esp generative models.
Applications: CryoEM (cryoSPARC), Statistics (Stan), Forensics, and more
Assoc Prof@York University, Toronto
mbrubake.github.io
Research: Computer Vision and Machine Learning, esp generative models.
Applications: CryoEM (cryoSPARC), Statistics (Stan), Forensics, and more
Ever wonder why SGD, which works so well for ab initio cryo-EM, never seems to get to high resolution on its own? Well, we have the answer: conditioning!
Work on SGD for high-resolution cryo-EM refinement from my previous postdoc finally published in @actacrystd.iucr.org
with Roy Lederman and @marcusabrubaker.bsky.social
📜 Paper: journals.iucr.org/paper?S20597...
💻 Code: github.com/bogdantoader...
💾 Data: doi.org/10.5281/zeno...
with Roy Lederman and @marcusabrubaker.bsky.social
📜 Paper: journals.iucr.org/paper?S20597...
💻 Code: github.com/bogdantoader...
💾 Data: doi.org/10.5281/zeno...
June 24, 2025 at 9:31 PM
Ever wonder why SGD, which works so well for ab initio cryo-EM, never seems to get to high resolution on its own? Well, we have the answer: conditioning!
Calling all PhD students in vision/ML interested in working with a great team (+me!) at GDM doing cutting edge research in 3D computer vision and generative models!
Our team in Google DeepMind Toronto is hiring a Student Researcher for Summer 2025 to work on projects in Video generative models and 3D Computer Vision. If you are interested, please apply at: forms.gle/Yj1jmbvjBFQC...
Student Researcher, Google DeepMind in Generative Models and 3D Computer Vision
Location: Toronto
Duration: 6 months
Start date: Flexible in Spring/Summer 2025
Project Details:
The project focuses on advancing generative modeling and/or computer vision techniques. The primary go...
forms.gle
March 5, 2025 at 10:12 PM
Calling all PhD students in vision/ML interested in working with a great team (+me!) at GDM doing cutting edge research in 3D computer vision and generative models!
Congratulations to Shayan for a great job presenting our work at the poster on Friday and in a talk @workshopmlsb.bsky.social today!
December 15, 2024 at 10:27 PM
Congratulations to Shayan for a great job presenting our work at the poster on Friday and in a talk @workshopmlsb.bsky.social today!
Come check out our work on semi-amortized inference for cryoEM today at NeurIPS!
📅 Friday, Dec 13, 11 AM - 2 PM
📌 East Exhibit Hall A-C, Poster #1105
Paper: arxiv.org/abs/2406.10455
Website: shekshaa.github.io/semi-amortized-cryoem/
With: Shayan Shekarforoush, David Lindell and David Fleet
📅 Friday, Dec 13, 11 AM - 2 PM
📌 East Exhibit Hall A-C, Poster #1105
Paper: arxiv.org/abs/2406.10455
Website: shekshaa.github.io/semi-amortized-cryoem/
With: Shayan Shekarforoush, David Lindell and David Fleet
December 13, 2024 at 5:24 PM
Come check out our work on semi-amortized inference for cryoEM today at NeurIPS!
📅 Friday, Dec 13, 11 AM - 2 PM
📌 East Exhibit Hall A-C, Poster #1105
Paper: arxiv.org/abs/2406.10455
Website: shekshaa.github.io/semi-amortized-cryoem/
With: Shayan Shekarforoush, David Lindell and David Fleet
📅 Friday, Dec 13, 11 AM - 2 PM
📌 East Exhibit Hall A-C, Poster #1105
Paper: arxiv.org/abs/2406.10455
Website: shekshaa.github.io/semi-amortized-cryoem/
With: Shayan Shekarforoush, David Lindell and David Fleet
Ever tried to run COLMAP or other SfM pipeline only to have it fail due to movement in the video? Check out our new work exploring on how detect and mask dynamic objects!
Hello everyone!! 👋
Excited to be here and share our latest work to get started!
RoMo: Robust Motion Segmentation Improves Structure from Motion
romosfm.github.io
Boost the performance of your SfM pipeline on dynamic scenes! 🚀 RoMo masks dynamic objects in a video, in a zero-shot manner.
Excited to be here and share our latest work to get started!
RoMo: Robust Motion Segmentation Improves Structure from Motion
romosfm.github.io
Boost the performance of your SfM pipeline on dynamic scenes! 🚀 RoMo masks dynamic objects in a video, in a zero-shot manner.
December 3, 2024 at 4:40 PM
Ever tried to run COLMAP or other SfM pipeline only to have it fail due to movement in the video? Check out our new work exploring on how detect and mask dynamic objects!
Reposted by Marcus Brubaker
Anne Gagneux, Ségolène Martin, @quentinbertrand.bsky.social Remi Emonet and I wrote a tutorial blog post on flow matching: dl.heeere.com/conditional-... with lots of illustrations and intuition!
We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423
We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423
November 27, 2024 at 9:00 AM
Anne Gagneux, Ségolène Martin, @quentinbertrand.bsky.social Remi Emonet and I wrote a tutorial blog post on flow matching: dl.heeere.com/conditional-... with lots of illustrations and intuition!
We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423
We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423
Reposted by Marcus Brubaker
Reposted by Marcus Brubaker
For those who missed this post on the-network-that-is-not-to-be-named, I made public my "secrets" for writing a good CVPR paper (or any scientific paper). I've compiled these tips of many years. It's long but hopefully it helps people write better papers. perceiving-systems.blog/en/post/writ...
Writing a good scientific paper
perceiving-systems.blog
November 20, 2024 at 10:18 AM
For those who missed this post on the-network-that-is-not-to-be-named, I made public my "secrets" for writing a good CVPR paper (or any scientific paper). I've compiled these tips of many years. It's long but hopefully it helps people write better papers. perceiving-systems.blog/en/post/writ...
Reposted by Marcus Brubaker
📢 Research Opportunities!
We’re seeking highly motivated postdocs & PhD students to dive into groundbreaking #ComputerVision research, exploring the future of 3D/4D neural rendering.
1/3
We’re seeking highly motivated postdocs & PhD students to dive into groundbreaking #ComputerVision research, exploring the future of 3D/4D neural rendering.
1/3
November 21, 2024 at 12:41 AM
📢 Research Opportunities!
We’re seeking highly motivated postdocs & PhD students to dive into groundbreaking #ComputerVision research, exploring the future of 3D/4D neural rendering.
1/3
We’re seeking highly motivated postdocs & PhD students to dive into groundbreaking #ComputerVision research, exploring the future of 3D/4D neural rendering.
1/3
Reposted by Marcus Brubaker
I created 3 introductory notebooks on Flow Matching models to help get started with this exciting topic! ✨
1. Annotated Flow Matching paper: github.com/gle-bellier/...
2. Discrete Flow Matching: github.com/gle-bellier/...
3. Minimal FM in Jax: github.com/gle-bellier/...
1. Annotated Flow Matching paper: github.com/gle-bellier/...
2. Discrete Flow Matching: github.com/gle-bellier/...
3. Minimal FM in Jax: github.com/gle-bellier/...
GitHub - gle-bellier/flow-matching: Annotated Flow Matching paper
Annotated Flow Matching paper. Contribute to gle-bellier/flow-matching development by creating an account on GitHub.
github.com
November 18, 2024 at 9:43 AM
I created 3 introductory notebooks on Flow Matching models to help get started with this exciting topic! ✨
1. Annotated Flow Matching paper: github.com/gle-bellier/...
2. Discrete Flow Matching: github.com/gle-bellier/...
3. Minimal FM in Jax: github.com/gle-bellier/...
1. Annotated Flow Matching paper: github.com/gle-bellier/...
2. Discrete Flow Matching: github.com/gle-bellier/...
3. Minimal FM in Jax: github.com/gle-bellier/...
Reposted by Marcus Brubaker
6 years ago, in the days of GAN art, I wrote an article called "Can Computers Create Art?", arguing that computers should not be considered artists, regardless of how good image generation gets. People sometimes ask if my views have changed. I say, 1/🧵
www.mdpi.com/2076-0752/7/...
www.mdpi.com/2076-0752/7/...
Can Computers Create Art?
This essay discusses whether computers, using Artificial Intelligence (AI), could create art. First, the history of technologies that automated aspects of art is surveyed, including photography and an...
www.mdpi.com
November 11, 2024 at 7:09 PM
6 years ago, in the days of GAN art, I wrote an article called "Can Computers Create Art?", arguing that computers should not be considered artists, regardless of how good image generation gets. People sometimes ask if my views have changed. I say, 1/🧵
www.mdpi.com/2076-0752/7/...
www.mdpi.com/2076-0752/7/...
Reposted by Marcus Brubaker
Here's my the talk for the #SIGGRAPH 2024 Computer Graphics Achievement award, about my experiences in painting, computer graphics and the science of art. And how so much art and research are unplanned and unpredictable.
www.youtube.com/watch?v=ehgj...
aaronhertzmann.com/2024/08/19/j...
www.youtube.com/watch?v=ehgj...
aaronhertzmann.com/2024/08/19/j...
SIGGRAPH 2024 Award Talk: My journey in art and computing (so far)
YouTube video by Aaron Hertzmann
www.youtube.com
August 19, 2024 at 9:17 PM
Here's my the talk for the #SIGGRAPH 2024 Computer Graphics Achievement award, about my experiences in painting, computer graphics and the science of art. And how so much art and research are unplanned and unpredictable.
www.youtube.com/watch?v=ehgj...
aaronhertzmann.com/2024/08/19/j...
www.youtube.com/watch?v=ehgj...
aaronhertzmann.com/2024/08/19/j...
Reposted by Marcus Brubaker
The Computer Vision Foundation open access proceedings team is proud to announce that the #CVPR2024 proceedings is now online:
Main conference: openaccess.thecvf.com/CVPR2024
Workshops: openaccess.thecvf.com/CVPR2024_wor...
Enjoy and I'll see all of you in Seattle!
Main conference: openaccess.thecvf.com/CVPR2024
Workshops: openaccess.thecvf.com/CVPR2024_wor...
Enjoy and I'll see all of you in Seattle!
June 10, 2024 at 8:53 PM
The Computer Vision Foundation open access proceedings team is proud to announce that the #CVPR2024 proceedings is now online:
Main conference: openaccess.thecvf.com/CVPR2024
Workshops: openaccess.thecvf.com/CVPR2024_wor...
Enjoy and I'll see all of you in Seattle!
Main conference: openaccess.thecvf.com/CVPR2024
Workshops: openaccess.thecvf.com/CVPR2024_wor...
Enjoy and I'll see all of you in Seattle!