smallfly
@smallfly.bsky.social
Try / Share / Iterate — Creative Technologist / Chief of Innovation at Dpt.
Exploring the use of physical interfaces, depth, diffusion, and mixed reality.
#MixedReality #MR #AI #StableDiffusion
#MixedReality #MR #AI #StableDiffusion
June 1, 2025 at 1:21 AM
Exploring the use of physical interfaces, depth, diffusion, and mixed reality.
#MixedReality #MR #AI #StableDiffusion
#MixedReality #MR #AI #StableDiffusion
Quick one... Using depth to give volume and clip the background.
— Mixed Reality + Diffusion prototype
#MixedReality #MR #AI #StableDiffusion
— Mixed Reality + Diffusion prototype
#MixedReality #MR #AI #StableDiffusion
May 31, 2025 at 9:32 PM
Quick one... Using depth to give volume and clip the background.
— Mixed Reality + Diffusion prototype
#MixedReality #MR #AI #StableDiffusion
— Mixed Reality + Diffusion prototype
#MixedReality #MR #AI #StableDiffusion
Mixing flat and ‘3D’ snapshots to create a more immersive scene. The recording doesn’t quite capture the sense of depth on the heads—but in the Quest, it feels great.
—Mixed Reality + Diffusion to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
—Mixed Reality + Diffusion to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
May 20, 2025 at 9:27 PM
Mixing flat and ‘3D’ snapshots to create a more immersive scene. The recording doesn’t quite capture the sense of depth on the heads—but in the Quest, it feels great.
—Mixed Reality + Diffusion to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
—Mixed Reality + Diffusion to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
Live-tweaking the depth displacement—Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
May 19, 2025 at 8:37 PM
Live-tweaking the depth displacement—Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
May 19, 2025 at 2:35 AM
Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
I’ve been using that same alleyway as a sandbox for years—now with the Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
May 4, 2025 at 9:31 PM
I’ve been using that same alleyway as a sandbox for years—now with the Mixed Reality + Diffusion prototype to explore concepts, styles, and moods.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
April 26, 2025 at 8:59 PM
Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities.
#MixedReality #MR #AI #StableDiffusion #Quest3
#MixedReality #MR #AI #StableDiffusion #Quest3
Exploring how the prototype can be used to research concepts and styles—by transforming snapshots and anchoring them back into the real world.
#MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3
#MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3
April 25, 2025 at 11:08 PM
Exploring how the prototype can be used to research concepts and styles—by transforming snapshots and anchoring them back into the real world.
#MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3
#MixedReality #MR #AI #Passthrough #StableDiffusion #Quest3
Researching a darker mood with this one.
Mixed Reality + Diffusion prototype.
#MixedReality #MR #AI #StableDiffusion #Quest3
Mixed Reality + Diffusion prototype.
#MixedReality #MR #AI #StableDiffusion #Quest3
April 22, 2025 at 2:26 AM
Researching a darker mood with this one.
Mixed Reality + Diffusion prototype.
#MixedReality #MR #AI #StableDiffusion #Quest3
Mixed Reality + Diffusion prototype.
#MixedReality #MR #AI #StableDiffusion #Quest3
Away for the long weekend visiting family…
Once again using the Mixed Reality + Diffusion prototype to transform the environment.
#MR #AI #Passthrough #StableDiffusion #Quest3
Once again using the Mixed Reality + Diffusion prototype to transform the environment.
#MR #AI #Passthrough #StableDiffusion #Quest3
April 20, 2025 at 12:46 PM
Away for the long weekend visiting family…
Once again using the Mixed Reality + Diffusion prototype to transform the environment.
#MR #AI #Passthrough #StableDiffusion #Quest3
Once again using the Mixed Reality + Diffusion prototype to transform the environment.
#MR #AI #Passthrough #StableDiffusion #Quest3
Wishing the grey weather would go away.
Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
April 13, 2025 at 8:30 PM
Wishing the grey weather would go away.
Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
Mixed Reality + Diffusion prototype using Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
This time, my son had a Bob the Builder flashback with the Mixed Reality + Diffusion prototype.
Using the Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
Using the Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
April 13, 2025 at 1:05 PM
This time, my son had a Bob the Builder flashback with the Mixed Reality + Diffusion prototype.
Using the Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
Using the Quest Passthrough Camera API and SDXL Turbo.
#MR #AI #Passthrough #StableDiffusion #Quest3
Today my son took over the Mixed Reality + Diffusion prototype… First stop: Mario Kart.
#MR #AI #Passthrough #StableDiffusion #Quest3
#MR #AI #Passthrough #StableDiffusion #Quest3
April 13, 2025 at 2:28 AM
Today my son took over the Mixed Reality + Diffusion prototype… First stop: Mario Kart.
#MR #AI #Passthrough #StableDiffusion #Quest3
#MR #AI #Passthrough #StableDiffusion #Quest3
In this iteration, I’ve added SAM 2 to our workflow to segment people. Lisa and I had fun testing it in our lab—striking poses in sequence, with our bodies precisely isolated for a refined Stable Diffusion effect.
#MR #AI #Passthrough #StableDiffusion #Quest3
#MR #AI #Passthrough #StableDiffusion #Quest3
March 22, 2025 at 9:38 PM
In this iteration, I’ve added SAM 2 to our workflow to segment people. Lisa and I had fun testing it in our lab—striking poses in sequence, with our bodies precisely isolated for a refined Stable Diffusion effect.
#MR #AI #Passthrough #StableDiffusion #Quest3
#MR #AI #Passthrough #StableDiffusion #Quest3
Just updated my MR + Diffusion prototype to use Meta’s Passthrough Camera API. It’s a raw port for now; next, I'll focus on UX exploration. It’s now much easier to do a screen recording.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion
March 16, 2025 at 10:51 PM
Just updated my MR + Diffusion prototype to use Meta’s Passthrough Camera API. It’s a raw port for now; next, I'll focus on UX exploration. It’s now much easier to do a screen recording.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion
Daylight saving — Spring is coming — Mixed Reality + Stable Diffusion.
#MR #AI #StableDiffusion #spring
#MR #AI #StableDiffusion #spring
March 9, 2025 at 4:42 AM
Daylight saving — Spring is coming — Mixed Reality + Stable Diffusion.
#MR #AI #StableDiffusion #spring
#MR #AI #StableDiffusion #spring
I tried the XGrids Lixel L2 Pro thanks to skytech-drones-inc and XGrids. This LiDAR-based scanner is quite impressive. Here is a capture, rendered as 3D Gaussian splats, of the staircase of our building I captured while going up the levels.
#gaussiansplats #3dscan #gaussiansplatting #digitaltwin
#gaussiansplats #3dscan #gaussiansplatting #digitaltwin
March 2, 2025 at 4:46 PM
I tried the XGrids Lixel L2 Pro thanks to skytech-drones-inc and XGrids. This LiDAR-based scanner is quite impressive. Here is a capture, rendered as 3D Gaussian splats, of the staircase of our building I captured while going up the levels.
#gaussiansplats #3dscan #gaussiansplatting #digitaltwin
#gaussiansplats #3dscan #gaussiansplatting #digitaltwin
Mixed Reality + Stable Diffusion — Trying to escape the winter.
#MR #AI #StableDiffusion #Quest3 #madewithunity #montreal
#MR #AI #StableDiffusion #Quest3 #madewithunity #montreal
February 23, 2025 at 10:13 PM
Mixed Reality + Stable Diffusion — Trying to escape the winter.
#MR #AI #StableDiffusion #Quest3 #madewithunity #montreal
#MR #AI #StableDiffusion #Quest3 #madewithunity #montreal
February 22, 2025 at 10:18 PM
Mixed Reality + Stable Diffusion — How my desk might look after years of being abandoned.
#MR #AI #StableDiffusion #Quest3 #madewithunity
#MR #AI #StableDiffusion #Quest3 #madewithunity
February 21, 2025 at 11:46 PM
Mixed Reality + Stable Diffusion — How my desk might look after years of being abandoned.
#MR #AI #StableDiffusion #Quest3 #madewithunity
#MR #AI #StableDiffusion #Quest3 #madewithunity
February 16, 2025 at 11:07 PM
Quickly capturing a series of spatial snapshots, close to one another, of my surroundings, resulting in an alternate reality patchwork once processed through a Stable Diffusion workflow. The snapshots, not being perfectly aligned, create a sense of depth.
#MR #AI #StableDiffusion #ComfyUI #Quest3
#MR #AI #StableDiffusion #ComfyUI #Quest3
February 15, 2025 at 10:44 PM
Quickly capturing a series of spatial snapshots, close to one another, of my surroundings, resulting in an alternate reality patchwork once processed through a Stable Diffusion workflow. The snapshots, not being perfectly aligned, create a sense of depth.
#MR #AI #StableDiffusion #ComfyUI #Quest3
#MR #AI #StableDiffusion #ComfyUI #Quest3
Got a bit trigger-happy capturing Mixed Reality snapshots — Captured images from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity
February 3, 2025 at 3:58 AM
Got a bit trigger-happy capturing Mixed Reality snapshots — Captured images from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity
#MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity
[02/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion
February 2, 2025 at 2:08 AM
[02/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion
[01/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on RunPod io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion
February 1, 2025 at 9:25 PM
[01/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on RunPod io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR.
#MR #AI #StableDiffusion
#MR #AI #StableDiffusion