Cloud cover map... digital.weather.gov?zoom=7&lat=3... (Note you need to scroll to the right time)

Bunch of eclipse timing info... www.timeanddate.com/eclipse/in/u... (put in your location if out of PDT)

Seems pretty reasonable to me for there to be extensive trees of selection and mixture. Seems hard to have optimality on the key metrics that matter (speed, cost, quality) otherwise

Also in some sense, all neural architectures by their very nature are mixtures of experts! So... Yes :)

I believe this would have to assume that such a product would be perfect and that workers that use it would be perfect. Otherwise, companies want support, customization, additions etc. The same reasons that complex open source software can still make money.

The immediately adjacent example of open source software would seem to call this statement into question. Where does the "extremely unlikely" part come from with that taken into account?

Parea is a solution that is workable but still young. We've been using it with medium success.

Langfuse is something else I have been considering: langfuse.com/docs/dataset...

Yeah it seems to be a weird blind spot for the industry. Weird because it seems like everyone building anything for which they desire defined repeatable behavior with LLMs should need this more than python developers need pytest. Otherwise you wind up with regression whack-a-mole

@simonwillison.net do you have a favorite way to do pytest-like LLM evals? Deterministic functions and/or LLM-as-judge

@5calls.org is making it easy for us to get in touch with reps and push them to stand up

Is there a reason there's an email wall before I can get any useful info ? I'm sure that turns a lot of ppl around. 5calls.org mentioned above seems lower friction

My understanding is you can't. But you can use a pin 📌 emoji apparently in a comment combined with a plugin or add-on of some kind. To much for me

Of course you can always copy out the link

💯

Seems like a huge opportunity for a group to come in and build FB lite on top of the AT protocol, even if they want to keep BSky an X clone

v cool Carson. Congrats. I'll be following this

I'm compiling my own list here, with yours truly included by pure nepotism

bsky.app/profile/did:...

Watch Duty is well built and wonderful for alerting you of fire risk nearby and then providing you with the most detailed up to date information. Kudos to you @lukas.blue