@thomastraum.bsky.social
I'll look into storing them in sqlite, I use chromadb for now but I would much rather have them read from a file or in sqlite.
October 7, 2025 at 3:27 PM
I'll look into storing them in sqlite, I use chromadb for now but I would much rather have them read from a file or in sqlite.
thank you! if you dont mind me asking:
how come its so fast on searches then? dont you need to embed each query then via API
I used openai embeddings for a while but I didnt want to have 200ms speed penalty for getting the embedding of a query back.
I switched to a local embedding, super fast.
how come its so fast on searches then? dont you need to embed each query then via API
I used openai embeddings for a while but I didnt want to have 200ms speed penalty for getting the embedding of a query back.
I switched to a local embedding, super fast.
October 7, 2025 at 3:27 PM
thank you! if you dont mind me asking:
how come its so fast on searches then? dont you need to embed each query then via API
I used openai embeddings for a while but I didnt want to have 200ms speed penalty for getting the embedding of a query back.
I switched to a local embedding, super fast.
how come its so fast on searches then? dont you need to embed each query then via API
I used openai embeddings for a while but I didnt want to have 200ms speed penalty for getting the embedding of a query back.
I switched to a local embedding, super fast.
love the site. Are all your embeddings stored at www.mixedbread.com still and do you have a local cache or is it all API calls?
Mixedbread
The Search API for your data. Turn your documents into discoverable and understandable context for AI.
www.mixedbread.com
October 3, 2025 at 10:07 AM
love the site. Are all your embeddings stored at www.mixedbread.com still and do you have a local cache or is it all API calls?