Chonkie
banner
chonkieai.bsky.social
Chonkie
@chonkieai.bsky.social
CHONK all the docs with Chonkie! Building no nonsense solutions for your RAG applications 🦛✨ (DMs open)

chonkie.ai
Check out our full release notes here: github.com/chonkie-ai/c...

Happy Chonking! 🦛 ✨
Release v0.3.0 · chonkie-ai/chonkie
Highlights Added LateChunker support! You can use LateChunker in the following manner: from chonkie import LateChunker chunker = LateChunker( embedding_model="jinaai/jina-embeddings-v3", ...
github.com
December 25, 2024 at 4:39 PM
Chonkie is a fast boi ⚡ Late chunking all of War and Peace took less than 30 seconds! 💨 🤯
December 25, 2024 at 4:39 PM
Late chunking with Chonkie is simple and powerful 💪🏽
December 25, 2024 at 4:39 PM
Instead of segmenting data into fixed chunks upfront, late chunking postpones this decision until the latest possible moment—when more context is available. 🧠 This approach results in embeddings that are much richer in context, as they have "attended to" the entire context. ⚡
December 25, 2024 at 4:39 PM