Clybius
@clybius.valve-software.com
AI/ML Enjoyer, Codec Utilizer, Music Listener, Nobody Extraordinaire.
AV1 Encoder I work on, on github @ https://github.com/gianni-rosato/svt-av1-psy
NOT A VALVE EMPLOYEE
AV1 Encoder I work on, on github @ https://github.com/gianni-rosato/svt-av1-psy
NOT A VALVE EMPLOYEE
me and my geeked out chud friend chilling at da crib
December 3, 2025 at 8:05 PM
me and my geeked out chud friend chilling at da crib
Part of my research involves training, generating images (very rarely 'video'), and I fucked around with making shitpost music for a bit a year ago. The most embarrassing one for me is saying 'thank you', but I swear I only do it to encourage the idea that it's on the right direction for a process 🤗
October 24, 2025 at 4:55 PM
Part of my research involves training, generating images (very rarely 'video'), and I fucked around with making shitpost music for a bit a year ago. The most embarrassing one for me is saying 'thank you', but I swear I only do it to encourage the idea that it's on the right direction for a process 🤗
bonus image where i turned the guidance up
October 22, 2025 at 6:51 PM
bonus image where i turned the guidance up
the government doesnt want you to know this but the emojis on twitter are free. you can just download their svgs and convert them to png to train a lora on them
October 22, 2025 at 6:16 PM
the government doesnt want you to know this but the emojis on twitter are free. you can just download their svgs and convert them to png to train a lora on them
kid named Sex Murder Party by Gorillaz on the album Humanz:
October 18, 2025 at 8:04 PM
kid named Sex Murder Party by Gorillaz on the album Humanz:
my chud son's gay friend and him (i love them both)
July 13, 2025 at 6:38 PM
my chud son's gay friend and him (i love them both)
reminder that its morally exquisite to dehumanize conservatives who've been consistently wrong on every social issue 👍
my dog has more empathy and smarts about the world than these "people"
my dog has more empathy and smarts about the world than these "people"
July 4, 2025 at 12:47 PM
reminder that its morally exquisite to dehumanize conservatives who've been consistently wrong on every social issue 👍
my dog has more empathy and smarts about the world than these "people"
my dog has more empathy and smarts about the world than these "people"
mfw they make an AR model to detect grain coefficients but don't release it to the public (consumers still have to rely on using a built-in simple temporal filter)
July 3, 2025 at 9:46 PM
mfw they make an AR model to detect grain coefficients but don't release it to the public (consumers still have to rely on using a built-in simple temporal filter)
is this song open-source or smth?
June 10, 2025 at 2:19 PM
is this song open-source or smth?
me after telling multiple maga conservatives to commit to a very high jump at The Sunshine Skyway bridge in Florida (its morally acceptable to tell them to do such as to prevent further harm)
June 10, 2025 at 11:55 AM
me after telling multiple maga conservatives to commit to a very high jump at The Sunshine Skyway bridge in Florida (its morally acceptable to tell them to do such as to prevent further harm)
i had more written but i felt its overly crude and doesn't represent how i'd unironically think.
but the feeling is 100% there :^)
but the feeling is 100% there :^)
May 20, 2025 at 3:19 PM
i had more written but i felt its overly crude and doesn't represent how i'd unironically think.
but the feeling is 100% there :^)
but the feeling is 100% there :^)
"owl im watchin yo stream, why you tryin not to laugh bruh, thats disrespectful as shit"
January 26, 2025 at 2:45 AM
"owl im watchin yo stream, why you tryin not to laugh bruh, thats disrespectful as shit"
nourishing. in my lane. chillaxin.
January 12, 2025 at 7:15 PM
nourishing. in my lane. chillaxin.
we're up good with deadlock bro..,
November 29, 2024 at 7:45 PM
we're up good with deadlock bro..,
TL;DR:
Distilled Flux12B → Flux8.8B by replacing a modulation layer with a feedforward block.
Initialized with his PFP, and it persisted through training!
Here some comparison images
Distilled Flux12B → Flux8.8B by replacing a modulation layer with a feedforward block.
Initialized with his PFP, and it persisted through training!
Here some comparison images
November 21, 2024 at 7:35 PM
TL;DR:
Distilled Flux12B → Flux8.8B by replacing a modulation layer with a feedforward block.
Initialized with his PFP, and it persisted through training!
Here some comparison images
Distilled Flux12B → Flux8.8B by replacing a modulation layer with a feedforward block.
Initialized with his PFP, and it persisted through training!
Here some comparison images
Why did the profile pictures persist in the weights?
During training optimization, the FF weights barely changed even when you train your model for a long time.
This highlights how initialization artifacts can sometimes remain visible in the final model.
left init, right trained
During training optimization, the FF weights barely changed even when you train your model for a long time.
This highlights how initialization artifacts can sometimes remain visible in the final model.
left init, right trained
November 21, 2024 at 7:35 PM
Why did the profile pictures persist in the weights?
During training optimization, the FF weights barely changed even when you train your model for a long time.
This highlights how initialization artifacts can sometimes remain visible in the final model.
left init, right trained
During training optimization, the FF weights barely changed even when you train your model for a long time.
This highlights how initialization artifacts can sometimes remain visible in the final model.
left init, right trained
The trick? Replacing the modulation layer with a feedforward block.
And the kicker? He initialized the feedforward layer using his profile picture tensor.
And the kicker? He initialized the feedforward layer using his profile picture tensor.
November 21, 2024 at 7:35 PM
The trick? Replacing the modulation layer with a feedforward block.
And the kicker? He initialized the feedforward layer using his profile picture tensor.
And the kicker? He initialized the feedforward layer using his profile picture tensor.
Lodestone-Rock just distilled Flux dev & schnell from 12B to 8.8B parameters—replacing the modulation layer with a feedforward block. 🚀
Plus, a fascinating stuff during distillation: profile picture, used as initialization, persisted in the trained weights! Details below. 🧵
Plus, a fascinating stuff during distillation: profile picture, used as initialization, persisted in the trained weights! Details below. 🧵
November 21, 2024 at 7:35 PM
Lodestone-Rock just distilled Flux dev & schnell from 12B to 8.8B parameters—replacing the modulation layer with a feedforward block. 🚀
Plus, a fascinating stuff during distillation: profile picture, used as initialization, persisted in the trained weights! Details below. 🧵
Plus, a fascinating stuff during distillation: profile picture, used as initialization, persisted in the trained weights! Details below. 🧵
