lukehollis
@lukehollis.bsky.social
RL and 3d graphics | applied ai | founder struct | teaching weird physics simulations | prev CS / 3d @ Harvard, MIT
fish multi-agent RL eating food and running away from shark
migrating ML-Agents from Unity to three.js+torch
migrating ML-Agents from Unity to three.js+torch
July 17, 2025 at 11:09 PM
fish multi-agent RL eating food and running away from shark
migrating ML-Agents from Unity to three.js+torch
migrating ML-Agents from Unity to three.js+torch
RL+LLM now running in a minecraft sandbox in the Three.js ML-Agents
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
July 17, 2025 at 11:08 PM
RL+LLM now running in a minecraft sandbox in the Three.js ML-Agents
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
agents use their trained policies as well as collaborate via an LLM to trade resources to achieve complex crafting tasks with a memory stream
up on gh, can run locally with ollama & gemma3n
Dynamic soaring glider riding thermal wind patterns implemented with RL
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
July 11, 2025 at 2:55 PM
Dynamic soaring glider riding thermal wind patterns implemented with RL
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
The latest migrating away from Unity ML-Agents to Three.js + torch in the backend
working on training an RL agents from a text prompt, this is a pizza delivery truck tiny model
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
June 19, 2025 at 6:54 AM
working on training an RL agents from a text prompt, this is a pizza delivery truck tiny model
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
so text prompt designs reward, obs & action spaces, trains about 30k steps in browser simulator google earth 3d map tiles
now supporting king kong, cthulu, and giant robots in my map creator tool
May 31, 2025 at 6:38 PM
now supporting king kong, cthulu, and giant robots in my map creator tool
Testing out chat with CAD file
Project engineers should have superpowers like software engineers 🚀
Project engineers should have superpowers like software engineers 🚀
May 27, 2025 at 5:10 AM
Testing out chat with CAD file
Project engineers should have superpowers like software engineers 🚀
Project engineers should have superpowers like software engineers 🚀
New timeline component added to the map simulator I've been building
Now you can step through simulations interactively and learn about them
Now you can step through simulations interactively and learn about them
May 26, 2025 at 6:10 PM
New timeline component added to the map simulator I've been building
Now you can step through simulations interactively and learn about them
Now you can step through simulations interactively and learn about them
You can use the MARL traffic / human behavior sims I've been building on your own maps! Repo on gh
May 15, 2025 at 11:33 PM
You can use the MARL traffic / human behavior sims I've been building on your own maps! Repo on gh
Simulations now interactively build on map and build way faster with Sambanova
Went from 3-5 mins to 30ish seconds
Went from 3-5 mins to 30ish seconds
May 15, 2025 at 2:50 PM
Simulations now interactively build on map and build way faster with Sambanova
Went from 3-5 mins to 30ish seconds
Went from 3-5 mins to 30ish seconds
Okay urban sim MARL model deployed! Still pretty early, will get more performant and add more people
Next up Godzilla
Next up Godzilla
May 7, 2025 at 2:51 PM
Okay urban sim MARL model deployed! Still pretty early, will get more performant and add more people
Next up Godzilla
Next up Godzilla
got up to 100k agents running realtime brining the city to life! ✊
May 4, 2025 at 5:13 PM
got up to 100k agents running realtime brining the city to life! ✊
Traffic sim now in! MARL model, elevation api costs for routes are brutal
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
May 3, 2025 at 1:12 PM
Traffic sim now in! MARL model, elevation api costs for routes are brutal
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Going to figure out a workaround for the elevation api and then make them interact with whatever's simulated on the map!
Launched text to simulate anything in 3d on a map! I'm actually really excited about this
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
April 22, 2025 at 7:55 PM
Launched text to simulate anything in 3d on a map! I'm actually really excited about this
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
You can simulate and conduct route risk analysis with millions of datapoints from social media and news using a custom world model that I trained on historical incident data
Out on homepage now 🔥
Announcing: Chat to simulate anything on a map! 🗺️
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
April 8, 2025 at 4:22 PM
Announcing: Chat to simulate anything on a map! 🗺️
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Excited to share my latest work -- chat to a map to create a 3d simulation of anything from supply chain to route risk analysis to historical events.
Link following..
Hacking thermal cfd in Unreal with Niagara fluid for simulations in our 3d scans
I think this is going to work!
I think this is going to work!
February 8, 2025 at 2:32 PM
Hacking thermal cfd in Unreal with Niagara fluid for simulations in our 3d scans
I think this is going to work!
I think this is going to work!
happy to announce on our anniversary that we're used by 100% of the top 100 unis in the world for teaching & training!
More coming to headsets soon
More coming to headsets soon
February 5, 2025 at 4:28 PM
happy to announce on our anniversary that we're used by 100% of the top 100 unis in the world for teaching & training!
More coming to headsets soon
More coming to headsets soon
Simulations progress! Getting full functioning cities and supply chain together now in Unreal, code
github.com/lukehollis/a...
github.com/lukehollis/a...
February 4, 2025 at 8:19 PM
Simulations progress! Getting full functioning cities and supply chain together now in Unreal, code
github.com/lukehollis/a...
github.com/lukehollis/a...
Training 100,000 hours of cat for VR game
Inspired by Nvidia Isaac gym
Inspired by Nvidia Isaac gym
January 31, 2025 at 7:59 PM
Training 100,000 hours of cat for VR game
Inspired by Nvidia Isaac gym
Inspired by Nvidia Isaac gym
Getting reinforcement learning running in engine in Unreal, migrating character AI from other projects for my VR game
Training and everything running in blueprints, yikes. The neural networks are data assets
Training and everything running in blueprints, yikes. The neural networks are data assets
January 29, 2025 at 6:41 PM
Getting reinforcement learning running in engine in Unreal, migrating character AI from other projects for my VR game
Training and everything running in blueprints, yikes. The neural networks are data assets
Training and everything running in blueprints, yikes. The neural networks are data assets
Taking the generalist NPCs that I used to simulate historical cities & putting them in our own! Working on a simulation of the Bay area for the BART transit system Link21 project proposing a new tunnel underneath the bay
January 21, 2025 at 3:48 PM
Taking the generalist NPCs that I used to simulate historical cities & putting them in our own! Working on a simulation of the Bay area for the BART transit system Link21 project proposing a new tunnel underneath the bay