michael bommarito
mjbommar.bsky.social
michael bommarito
@mjbommar.bsky.social
i really want to support the pleias common corpus project as an example of what to do, but the reality is that it's full of the same AGPL, non-commercial or share-alike, etc...from a legal perspective, this is no different than The Pile, and it's certainly not unrestricted.
December 3, 2024 at 2:32 PM
in the early(ier) days of social media, i was one of "those" researchers who would release datasets or related source (livejournal c 2004, twitter 2008-2012). i now wish i hadn't released some of what i did...
November 28, 2024 at 4:18 PM
there is so much happening in so many interacting social, geopolitical, and technical dimensions that it can be difficult to figure out what information to collect, let alone how to forecast and predict. that said, the pretraining cost trend is singularly important:
November 25, 2024 at 2:50 PM
me: so it's gonna be a quiet monday morning, right?

monday:
November 18, 2024 at 1:23 PM