lyra bubbles ♪❀
@lyraaaa.dev
ˈli.ɹə 🏳️⚧️⚢ · 24 · ableton enjoyer · developing music ai tools · geography nerd · base model appreciator · beat saber · ♡ @chloebubbles.gay ♡
which basically makes it its own data flywheel.. back to original point :)
August 29, 2023 at 11:05 AM
which basically makes it its own data flywheel.. back to original point :)
more comprehensive and efficient data flywheel code >>>
quality labelled training data currently biggest bottleneck imo given current multimodal architectures and compute clusters
quality labelled training data currently biggest bottleneck imo given current multimodal architectures and compute clusters
August 29, 2023 at 11:03 AM
more comprehensive and efficient data flywheel code >>>
quality labelled training data currently biggest bottleneck imo given current multimodal architectures and compute clusters
quality labelled training data currently biggest bottleneck imo given current multimodal architectures and compute clusters
10 years? likely sooner... we went from 1024 to 100k in 4 years and there's so many more people working on it these days finding tricks like that little *2 in llama
August 29, 2023 at 10:58 AM
10 years? likely sooner... we went from 1024 to 100k in 4 years and there's so many more people working on it these days finding tricks like that little *2 in llama
only downside is context window. can't fit the entirety of the audiocraft repo in one context, which I currently need to do for... reasons
August 29, 2023 at 10:53 AM
only downside is context window. can't fit the entirety of the audiocraft repo in one context, which I currently need to do for... reasons
and then after that-
"please read all this code so I don't have to. restructure it this way, and add that. I'll give you documentation and fix the bugs"
"please read all this code so I don't have to. restructure it this way, and add that. I'll give you documentation and fix the bugs"
August 29, 2023 at 10:46 AM
and then after that-
"please read all this code so I don't have to. restructure it this way, and add that. I'll give you documentation and fix the bugs"
"please read all this code so I don't have to. restructure it this way, and add that. I'll give you documentation and fix the bugs"