lukehollis
@lukehollis.bsky.social
RL and 3d graphics | applied ai | founder struct | teaching weird physics simulations | prev CS / 3d @ Harvard, MIT
fish multi-agent RL eating food and running away from shark
migrating ML-Agents from Unity to three.js+torch
migrating ML-Agents from Unity to three.js+torch
July 17, 2025 at 11:09 PM
fish multi-agent RL eating food and running away from shark
migrating ML-Agents from Unity to three.js+torch
migrating ML-Agents from Unity to three.js+torch
RL+LLM now running in a minecraft sandbox in the Three.js ML-Agents
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
July 17, 2025 at 11:08 PM
RL+LLM now running in a minecraft sandbox in the Three.js ML-Agents
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
Dynamic soaring glider riding thermal wind patterns implemented with RL
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
July 11, 2025 at 2:55 PM
Dynamic soaring glider riding thermal wind patterns implemented with RL
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
I can't open my old Unity projects anymore without an Enterprise license, is anyone doing ML-Agents but in Three.js yet?
June 29, 2025 at 1:15 PM
I can't open my old Unity projects anymore without an Enterprise license, is anyone doing ML-Agents but in Three.js yet?
working on training an RL agents from a text prompt, this is a pizza delivery truck tiny model
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
June 19, 2025 at 6:54 AM
working on training an RL agents from a text prompt, this is a pizza delivery truck tiny model
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
now supporting king kong, cthulu, and giant robots in my map creator tool
May 31, 2025 at 6:38 PM
now supporting king kong, cthulu, and giant robots in my map creator tool
Testing out chat with CAD file
Project engineers should have superpowers like software engineers 🚀
Project engineers should have superpowers like software engineers 🚀
May 27, 2025 at 5:10 AM
Testing out chat with CAD file
Project engineers should have superpowers like software engineers 🚀
Project engineers should have superpowers like software engineers 🚀
New timeline component added to the map simulator I've been building
Now you can step through simulations interactively and learn about them
Now you can step through simulations interactively and learn about them
May 26, 2025 at 6:10 PM
New timeline component added to the map simulator I've been building
Now you can step through simulations interactively and learn about them
Now you can step through simulations interactively and learn about them
You can use the MARL traffic / human behavior sims I've been building on your own maps! Repo on gh
May 15, 2025 at 11:33 PM
You can use the MARL traffic / human behavior sims I've been building on your own maps! Repo on gh
Simulations now interactively build on map and build way faster with Sambanova
Went from 3-5 mins to 30ish seconds
Went from 3-5 mins to 30ish seconds
May 15, 2025 at 2:50 PM
Simulations now interactively build on map and build way faster with Sambanova
Went from 3-5 mins to 30ish seconds
Went from 3-5 mins to 30ish seconds
Okay urban sim MARL model deployed! Still pretty early, will get more performant and add more people
Next up Godzilla
Next up Godzilla
May 7, 2025 at 2:51 PM
Okay urban sim MARL model deployed! Still pretty early, will get more performant and add more people
Next up Godzilla
Next up Godzilla
got up to 100k agents running realtime brining the city to life! ✊
May 4, 2025 at 5:13 PM
got up to 100k agents running realtime brining the city to life! ✊
Traffic sim now in! MARL model, elevation api costs for routes are brutal
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
May 3, 2025 at 1:12 PM
Traffic sim now in! MARL model, elevation api costs for routes are brutal
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Launched text to simulate anything in 3d on a map! I'm actually really excited about this
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
April 22, 2025 at 7:55 PM
Launched text to simulate anything in 3d on a map! I'm actually really excited about this
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
Anyone else still having datetime woes w/BC dates in Django/postgres? Built a package to extend django's native support to match postgres: low: 4713 BC
high: 294276 AD
high: 294276 AD
April 13, 2025 at 6:16 PM
Anyone else still having datetime woes w/BC dates in Django/postgres? Built a package to extend django's native support to match postgres: low: 4713 BC
high: 294276 AD
high: 294276 AD
Announcing: Chat to simulate anything on a map! 🗺️
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
April 8, 2025 at 4:22 PM
Announcing: Chat to simulate anything on a map! 🗺️
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Breaking out of the 3d simulations work for GDC! Hanging out at Expo today
March 20, 2025 at 9:18 PM
Breaking out of the 3d simulations work for GDC! Hanging out at Expo today
Hey thanks for sharing! I made this tour. I just used it for teaching 4th and 7th grade history classes, and the students lost it at the Christos Pantokrater
Glad for any feedback -- and I just accidentally broke the maps in a code release, I'll get them fixed shortly!
Glad for any feedback -- and I just accidentally broke the maps in a code release, I'll get them fixed shortly!
March 20, 2025 at 9:13 PM
Hey thanks for sharing! I made this tour. I just used it for teaching 4th and 7th grade history classes, and the students lost it at the Christos Pantokrater
Glad for any feedback -- and I just accidentally broke the maps in a code release, I'll get them fixed shortly!
Glad for any feedback -- and I just accidentally broke the maps in a code release, I'll get them fixed shortly!
Hacking thermal cfd in Unreal with Niagara fluid for simulations in our 3d scans
I think this is going to work!
I think this is going to work!
February 8, 2025 at 2:32 PM
Hacking thermal cfd in Unreal with Niagara fluid for simulations in our 3d scans
I think this is going to work!
I think this is going to work!
happy to announce on our anniversary that we're used by 100% of the top 100 unis in the world for teaching & training!
More coming to headsets soon
More coming to headsets soon
February 5, 2025 at 4:28 PM
happy to announce on our anniversary that we're used by 100% of the top 100 unis in the world for teaching & training!
More coming to headsets soon
More coming to headsets soon
Simulations progress! Getting full functioning cities and supply chain together now in Unreal, code
github.com/lukehollis/a...
github.com/lukehollis/a...
February 4, 2025 at 8:19 PM
Simulations progress! Getting full functioning cities and supply chain together now in Unreal, code
github.com/lukehollis/a...
github.com/lukehollis/a...
Added a new logo for my open source three.js virtual tour / digital twin builder! What do you think?
Code: github.com/lukehollis/s...
Code: github.com/lukehollis/s...
February 2, 2025 at 4:59 PM
Added a new logo for my open source three.js virtual tour / digital twin builder! What do you think?
Code: github.com/lukehollis/s...
Code: github.com/lukehollis/s...
Training 100,000 hours of cat for VR game
Inspired by Nvidia Isaac gym
Inspired by Nvidia Isaac gym
January 31, 2025 at 7:59 PM
Training 100,000 hours of cat for VR game
Inspired by Nvidia Isaac gym
Inspired by Nvidia Isaac gym
Getting reinforcement learning running in engine in Unreal, migrating character AI from other projects for my VR game
Training and everything running in blueprints, yikes. The neural networks are data assets
Training and everything running in blueprints, yikes. The neural networks are data assets
January 29, 2025 at 6:41 PM
Getting reinforcement learning running in engine in Unreal, migrating character AI from other projects for my VR game
Training and everything running in blueprints, yikes. The neural networks are data assets
Training and everything running in blueprints, yikes. The neural networks are data assets
Taking the generalist NPCs that I used to simulate historical cities & putting them in our own! Working on a simulation of the Bay area for the BART transit system Link21 project proposing a new tunnel underneath the bay
January 21, 2025 at 3:48 PM
Taking the generalist NPCs that I used to simulate historical cities & putting them in our own! Working on a simulation of the Bay area for the BART transit system Link21 project proposing a new tunnel underneath the bay