www.youtube.com/watch?v=Zueo...
www.youtube.com/watch?v=Zueo...
It might be one way to dip your toe and then proceed.
I’ve done some tinkering on Bluesky. I’ve been told the firehose can effectively be consumed on a Raspberry Pi, but I haven’t setup one of my own Raspberry Pi devices to test this theory.
It might be one way to dip your toe and then proceed.
I’ve done some tinkering on Bluesky. I’ve been told the firehose can effectively be consumed on a Raspberry Pi, but I haven’t setup one of my own Raspberry Pi devices to test this theory.
- Garbage in, garbage out. Wire it up to interesting data and integrations.
- If a compound system has LLM-level intelligence in the middle, something akin to AI evals are often required to test the overall compound system performance too.
- Garbage in, garbage out. Wire it up to interesting data and integrations.
- If a compound system has LLM-level intelligence in the middle, something akin to AI evals are often required to test the overall compound system performance too.
- Much of what we reason about is recent, but LLMs have knowledge cutoffs. Pack your context with all kinds of recent knowledge.
- As software components with downstream effects, either insert LLMs where error is contained (ie. retry priority), or create suggestions for a human to accept.
- Much of what we reason about is recent, but LLMs have knowledge cutoffs. Pack your context with all kinds of recent knowledge.
- As software components with downstream effects, either insert LLMs where error is contained (ie. retry priority), or create suggestions for a human to accept.
- API costs can add up fast. The simpler models and local models are very capable. Don't pay tolls if you don't have to.
- Orchestration can be done with things like functions and coroutines. Orchestration frameworks have a lot of downsides.
- API costs can add up fast. The simpler models and local models are very capable. Don't pay tolls if you don't have to.
- Orchestration can be done with things like functions and coroutines. Orchestration frameworks have a lot of downsides.
Some of my AI learnings:
- Vectors can be stored in a lot of places. Vector databases have a lot of downsides.
- Many embeddings can be instruction-tuned. You can fine tune via a special textual prompt on top of the user prompt.
Some of my AI learnings:
- Vectors can be stored in a lot of places. Vector databases have a lot of downsides.
- Many embeddings can be instruction-tuned. You can fine tune via a special textual prompt on top of the user prompt.