👇

bsky is a wonderful little place, and it has certainly recaptured some of that "early twitter" feel. sadly, whether because of the difference in feed algos or just network composition, i still seem to find the Other Site much more "useful"

i really want to support the pleias common corpus project as an example of what to do, but the reality is that it's full of the same AGPL, non-commercial or share-alike, etc...from a legal perspective, this is no different than The Pile, and it's certainly not unrestricted.

in the early(ier) days of social media, i was one of "those" researchers who would release datasets or related source (livejournal c 2004, twitter 2008-2012). i now wish i hadn't released some of what i did...

there is so much happening in so many interacting social, geopolitical, and technical dimensions that it can be difficult to figure out what information to collect, let alone how to forecast and predict. that said, the pretraining cost trend is singularly important:

me: so it's gonna be a quiet monday morning, right?

monday:

this needs to be required reading:
www.lesswrong.com/posts/5jjk4C...

after 25 years of switching platform-switching, i don't know if i can do another...but unlike X, at least the name of this place brings a smile to my face. www.youtube.com/watch?v=dalF...