I somehow got into an argument last week with someone who was insisting that all models are industrial blackboxes... and I wish I'd had this on hand.
I somehow got into an argument last week with someone who was insisting that all models are industrial blackboxes... and I wish I'd had this on hand.
2. Quality. Does my work meet or exceed customer expectations?
3. Efficiency. Reward making the right buy versus build decision.
4. Reusability. How do others leverage my work?
5. Supportability. How much work do I create for others?
if you could wave a magic wand and have your performance/promotability measured on any 5 metrics of your choice, what would those metrics be?
2. Quality. Does my work meet or exceed customer expectations?
3. Efficiency. Reward making the right buy versus build decision.
4. Reusability. How do others leverage my work?
5. Supportability. How much work do I create for others?
Typically, you'd train a VQ-VAE/GAN tokenizer first, and then use its tokens for your LLM/DiT/... But we all know eventually end-to-end wins over pipelines.
With flow models, you can actually learn pixel-LLM-pixel end-to-end!
We have been pondering this during summer and developed a new model: JetFormer 🌊🤖
arxiv.org/abs/2411.19722
A thread 👇
1/
Typically, you'd train a VQ-VAE/GAN tokenizer first, and then use its tokens for your LLM/DiT/... But we all know eventually end-to-end wins over pipelines.
With flow models, you can actually learn pixel-LLM-pixel end-to-end!
That kindness is always going to be appreciated by creators, but if you want to help to boost something here, you have to repost it so others see it. 🙂
That kindness is always going to be appreciated by creators, but if you want to help to boost something here, you have to repost it so others see it. 🙂
go.bsky.app/PkAKJu5
go.bsky.app/PkAKJu5