David Berenstein
@davidberenstein.bsky.social
ML & DevRel @ Giskard & Pruna | ex HF 🤗 | 👨🏽🍳 Cooking, 👨🏽💻 Coding, 🏆 Committing
🔥 Bespoke curator: Synthetic Data Curation for Post-Training & Structured Data Extraction
Create synthetic data pipelines with easy!
- Retries and caching included
- inference via LiteLLM, vLLM, and popular batch APIs
- asynchronous operations
🔗 URL: buff.ly/ajPRT1l
Create synthetic data pipelines with easy!
- Retries and caching included
- inference via LiteLLM, vLLM, and popular batch APIs
- asynchronous operations
🔗 URL: buff.ly/ajPRT1l
April 10, 2025 at 12:00 PM
🔥 Bespoke curator: Synthetic Data Curation for Post-Training & Structured Data Extraction
Create synthetic data pipelines with easy!
- Retries and caching included
- inference via LiteLLM, vLLM, and popular batch APIs
- asynchronous operations
🔗 URL: buff.ly/ajPRT1l
Create synthetic data pipelines with easy!
- Retries and caching included
- inference via LiteLLM, vLLM, and popular batch APIs
- asynchronous operations
🔗 URL: buff.ly/ajPRT1l
🔥One > token > at > a > time < a < at < token < One 🔥
token-explorer is a simple tool that lets you explore different possible paths that an LLM might sample!
- Arrow keys to navigate, pop and append tokens
- View the token probabilities and entropies.
GitHub: buff.ly/FQgsczM
token-explorer is a simple tool that lets you explore different possible paths that an LLM might sample!
- Arrow keys to navigate, pop and append tokens
- View the token probabilities and entropies.
GitHub: buff.ly/FQgsczM
April 3, 2025 at 12:22 PM
🔥One > token > at > a > time < a < at < token < One 🔥
token-explorer is a simple tool that lets you explore different possible paths that an LLM might sample!
- Arrow keys to navigate, pop and append tokens
- View the token probabilities and entropies.
GitHub: buff.ly/FQgsczM
token-explorer is a simple tool that lets you explore different possible paths that an LLM might sample!
- Arrow keys to navigate, pop and append tokens
- View the token probabilities and entropies.
GitHub: buff.ly/FQgsczM
🍽️ Let’s dissect the Synthetic Dataset Generator
💬 Natural language prompt to data
🦙 Ollama ensures secure local LLM inference
✍🏼 Argilla’s data curation capabilities complete the workflow
🔗 GitHub: buff.ly/5pX49Xc
💬 Natural language prompt to data
🦙 Ollama ensures secure local LLM inference
✍🏼 Argilla’s data curation capabilities complete the workflow
🔗 GitHub: buff.ly/5pX49Xc
GitHub - argilla-io/synthetic-data-generator: Build datasets using natural language
Build datasets using natural language. Contribute to argilla-io/synthetic-data-generator development by creating an account on GitHub.
buff.ly
March 7, 2025 at 1:00 PM
🍽️ Let’s dissect the Synthetic Dataset Generator
💬 Natural language prompt to data
🦙 Ollama ensures secure local LLM inference
✍🏼 Argilla’s data curation capabilities complete the workflow
🔗 GitHub: buff.ly/5pX49Xc
💬 Natural language prompt to data
🦙 Ollama ensures secure local LLM inference
✍🏼 Argilla’s data curation capabilities complete the workflow
🔗 GitHub: buff.ly/5pX49Xc
🔥 Text2SQL, explore and share any data analysis!
🤗 Hugging Face - Dataset Studio is an amazing new feature.
🚀 Start yourself: buff.ly/pjpOKav
🤗 Hugging Face - Dataset Studio is an amazing new feature.
🚀 Start yourself: buff.ly/pjpOKav
March 5, 2025 at 10:01 AM
🔥 Text2SQL, explore and share any data analysis!
🤗 Hugging Face - Dataset Studio is an amazing new feature.
🚀 Start yourself: buff.ly/pjpOKav
🤗 Hugging Face - Dataset Studio is an amazing new feature.
🚀 Start yourself: buff.ly/pjpOKav
🔥 Vicinity: SEVEN semantic search BACK-ENDS, ONE single INTERFACE!
🫸 New release to push vector search to the Hub and work with any serialisable objects.
🧑🏫 KNN, HNSW, USEARCH, ANNOY, PYNNDESCENT, FAISS, and VOYAGER.
🔗 Library:
🫸 New release to push vector search to the Hub and work with any serialisable objects.
🧑🏫 KNN, HNSW, USEARCH, ANNOY, PYNNDESCENT, FAISS, and VOYAGER.
🔗 Library:
GitHub - MinishLab/vicinity: Lightweight Nearest Neighbors with Flexible Backends
Lightweight Nearest Neighbors with Flexible Backends - MinishLab/vicinity
buff.ly
March 4, 2025 at 9:30 AM
🔥 Vicinity: SEVEN semantic search BACK-ENDS, ONE single INTERFACE!
🫸 New release to push vector search to the Hub and work with any serialisable objects.
🧑🏫 KNN, HNSW, USEARCH, ANNOY, PYNNDESCENT, FAISS, and VOYAGER.
🔗 Library:
🫸 New release to push vector search to the Hub and work with any serialisable objects.
🧑🏫 KNN, HNSW, USEARCH, ANNOY, PYNNDESCENT, FAISS, and VOYAGER.
🔗 Library:
🔥 NEW cool NO-CODE solution for clicking together AI WEB APPS!
🎨 Gradio released "gradio sketch"
🚼 Really easy way to create web apps with minimal code.
⚙️ Start with `pip install gradio` & `gradio sketch`
📒 Release: https://buff.ly/41aeLoA
🎨 Gradio released "gradio sketch"
🚼 Really easy way to create web apps with minimal code.
⚙️ Start with `pip install gradio` & `gradio sketch`
📒 Release: https://buff.ly/41aeLoA
February 27, 2025 at 10:13 AM
🔥 NEW cool NO-CODE solution for clicking together AI WEB APPS!
🎨 Gradio released "gradio sketch"
🚼 Really easy way to create web apps with minimal code.
⚙️ Start with `pip install gradio` & `gradio sketch`
📒 Release: https://buff.ly/41aeLoA
🎨 Gradio released "gradio sketch"
🚼 Really easy way to create web apps with minimal code.
⚙️ Start with `pip install gradio` & `gradio sketch`
📒 Release: https://buff.ly/41aeLoA
Vector Search - let's keep it clean and lightweight! ⚡️
<100K records, no problem!
>100K, some scaling issues
ANN DuckDB index, sub-second response times
Notebook:
<100K records, no problem!
>100K, some scaling issues
ANN DuckDB index, sub-second response times
Notebook:
vector_search_with_hub_as_backend.ipynb
Run, share, and edit Python notebooks
buff.ly
February 27, 2025 at 8:31 AM
Vector Search - let's keep it clean and lightweight! ⚡️
<100K records, no problem!
>100K, some scaling issues
ANN DuckDB index, sub-second response times
Notebook:
<100K records, no problem!
>100K, some scaling issues
ANN DuckDB index, sub-second response times
Notebook:
🔥 The smolagents module has arrived in the agents course!
💻 Code agents optimised for software development
🔧 Tool calling agents that create modular, function-driven workflows
🔍 Retrieval agents designed to access and synthesise information
Course: https://buff.ly/4kcj6Ai
💻 Code agents optimised for software development
🔧 Tool calling agents that create modular, function-driven workflows
🔍 Retrieval agents designed to access and synthesise information
Course: https://buff.ly/4kcj6Ai
February 25, 2025 at 3:40 PM
🔥 The smolagents module has arrived in the agents course!
💻 Code agents optimised for software development
🔧 Tool calling agents that create modular, function-driven workflows
🔍 Retrieval agents designed to access and synthesise information
Course: https://buff.ly/4kcj6Ai
💻 Code agents optimised for software development
🔧 Tool calling agents that create modular, function-driven workflows
🔍 Retrieval agents designed to access and synthesise information
Course: https://buff.ly/4kcj6Ai
🧑🏫 Awesome. My talk for PyCon Italy 2025 got accepted!
Got data problems? Relax. Synthetic data is here to help.
Talk: https://buff.ly/3QzoZKj
Got data problems? Relax. Synthetic data is here to help.
Talk: https://buff.ly/3QzoZKj
February 25, 2025 at 8:54 AM
🧑🏫 Awesome. My talk for PyCon Italy 2025 got accepted!
Got data problems? Relax. Synthetic data is here to help.
Talk: https://buff.ly/3QzoZKj
Got data problems? Relax. Synthetic data is here to help.
Talk: https://buff.ly/3QzoZKj
🐳 Announcing docker support to Quickly set up your Synthetic Data Generator with (Gradio + Ollama + Argilla)!
🔥 Build genuinely useful datasets using natural language!
⚖️ Scale however you need.
🔐 Use them privately or share them with the world!
🧑💻 GitHub: https://buff.ly/49IDSmd
🔥 Build genuinely useful datasets using natural language!
⚖️ Scale however you need.
🔐 Use them privately or share them with the world!
🧑💻 GitHub: https://buff.ly/49IDSmd
February 21, 2025 at 8:00 AM
🐳 Announcing docker support to Quickly set up your Synthetic Data Generator with (Gradio + Ollama + Argilla)!
🔥 Build genuinely useful datasets using natural language!
⚖️ Scale however you need.
🔐 Use them privately or share them with the world!
🧑💻 GitHub: https://buff.ly/49IDSmd
🔥 Build genuinely useful datasets using natural language!
⚖️ Scale however you need.
🔐 Use them privately or share them with the world!
🧑💻 GitHub: https://buff.ly/49IDSmd
With 80K agent builders joining the agents course, it is time to make agents explorable on the Hub!
You can now search and find the perfect agents and tools for your needs!
Powered by @Gradio!
Start searching:
You can now search and find the perfect agents and tools for your needs!
Powered by @Gradio!
Start searching:
smolagents and tools gallery - a Hugging Face Space by davidberenstein1957
Discover amazing ML apps made by the community
buff.ly
February 20, 2025 at 1:01 PM
With 80K agent builders joining the agents course, it is time to make agents explorable on the Hub!
You can now search and find the perfect agents and tools for your needs!
Powered by @Gradio!
Start searching:
You can now search and find the perfect agents and tools for your needs!
Powered by @Gradio!
Start searching:
Image Generation has landed in Arena form 🎨🤖!
1. Describe your desired image🎨
2. Two anonymous models output images
3. Vote for the winner!
Images have been sourced from our Open Image Preference dataset!
Dataset: https://buff.ly/4il0du9
Arena: https://buff.ly/4142NwH
1. Describe your desired image🎨
2. Two anonymous models output images
3. Vote for the winner!
Images have been sourced from our Open Image Preference dataset!
Dataset: https://buff.ly/4il0du9
Arena: https://buff.ly/4142NwH
February 19, 2025 at 11:05 AM
Image Generation has landed in Arena form 🎨🤖!
1. Describe your desired image🎨
2. Two anonymous models output images
3. Vote for the winner!
Images have been sourced from our Open Image Preference dataset!
Dataset: https://buff.ly/4il0du9
Arena: https://buff.ly/4142NwH
1. Describe your desired image🎨
2. Two anonymous models output images
3. Vote for the winner!
Images have been sourced from our Open Image Preference dataset!
Dataset: https://buff.ly/4il0du9
Arena: https://buff.ly/4142NwH
Are you, the top of the Agents class?!
We just released a bonus unit on function calling (FC).
You will learn:
⑴ What is FC?
⑵ Thought → Act → Observe Cycle in FC
⑶ lightweight and efficient fine-tuning
Course: https://buff.ly/3Qn1DHB
We just released a bonus unit on function calling (FC).
You will learn:
⑴ What is FC?
⑵ Thought → Act → Observe Cycle in FC
⑶ lightweight and efficient fine-tuning
Course: https://buff.ly/3Qn1DHB
February 18, 2025 at 4:14 PM
Are you, the top of the Agents class?!
We just released a bonus unit on function calling (FC).
You will learn:
⑴ What is FC?
⑵ Thought → Act → Observe Cycle in FC
⑶ lightweight and efficient fine-tuning
Course: https://buff.ly/3Qn1DHB
We just released a bonus unit on function calling (FC).
You will learn:
⑴ What is FC?
⑵ Thought → Act → Observe Cycle in FC
⑶ lightweight and efficient fine-tuning
Course: https://buff.ly/3Qn1DHB
📹 In case you've missed the hype around smolagents, here is a presentation I gave yesterday at an MLOps community event!
library: https://buff.ly/4hj6PrJ
slides: https://buff.ly/3WUzZ8D
video:
library: https://buff.ly/4hj6PrJ
slides: https://buff.ly/3WUzZ8D
video:
Smol Agents and Hugging Face - Anote AI Day Summit 2025
buff.ly
February 14, 2025 at 7:18 AM
📹 In case you've missed the hype around smolagents, here is a presentation I gave yesterday at an MLOps community event!
library: https://buff.ly/4hj6PrJ
slides: https://buff.ly/3WUzZ8D
video:
library: https://buff.ly/4hj6PrJ
slides: https://buff.ly/3WUzZ8D
video:
🚀 Find banger tools for your smolagents!
I created the Tools gallery, which makes tools specifically developed by/for smolagents searchable and visible. This will help with:
- inspiration
- best practices
- finding cool tools
Space: https://buff.ly/41cYctx
I created the Tools gallery, which makes tools specifically developed by/for smolagents searchable and visible. This will help with:
- inspiration
- best practices
- finding cool tools
Space: https://buff.ly/41cYctx
February 12, 2025 at 9:15 AM
🚀 Find banger tools for your smolagents!
I created the Tools gallery, which makes tools specifically developed by/for smolagents searchable and visible. This will help with:
- inspiration
- best practices
- finding cool tools
Space: https://buff.ly/41cYctx
I created the Tools gallery, which makes tools specifically developed by/for smolagents searchable and visible. This will help with:
- inspiration
- best practices
- finding cool tools
Space: https://buff.ly/41cYctx
🔥 Come and get those AI agents certificates!
Join the cohort of 66K students: https://buff.ly/4hxb6rK
Join the cohort of 66K students: https://buff.ly/4hxb6rK
February 10, 2025 at 2:38 PM
🔥 Come and get those AI agents certificates!
Join the cohort of 66K students: https://buff.ly/4hxb6rK
Join the cohort of 66K students: https://buff.ly/4hxb6rK
Documents or images to structured data using Vision Language Models
Outlines has an integration with transformers, which facilitates structured generation based on limiting token sampling probabilities.
Blog: https://buff.ly/4jFHMkr
Outlines has an integration with transformers, which facilitates structured generation based on limiting token sampling probabilities.
Blog: https://buff.ly/4jFHMkr
February 10, 2025 at 1:00 PM
Documents or images to structured data using Vision Language Models
Outlines has an integration with transformers, which facilitates structured generation based on limiting token sampling probabilities.
Blog: https://buff.ly/4jFHMkr
Outlines has an integration with transformers, which facilitates structured generation based on limiting token sampling probabilities.
Blog: https://buff.ly/4jFHMkr
Local docker deployments for the synthetic data generator 🫱🏾🫲🏼
We would love to hear your thoughts!
PR: https://buff.ly/4hRMny6
We would love to hear your thoughts!
PR: https://buff.ly/4hRMny6
February 10, 2025 at 10:13 AM
Local docker deployments for the synthetic data generator 🫱🏾🫲🏼
We would love to hear your thoughts!
PR: https://buff.ly/4hRMny6
We would love to hear your thoughts!
PR: https://buff.ly/4hRMny6
Curious about "Why 🚀", you may wonder?
smolagents effortlessness combined with the power of 400,000 AI tools available on the Hub!
library: https://buff.ly/4hj6PrJ
smolagents effortlessness combined with the power of 400,000 AI tools available on the Hub!
library: https://buff.ly/4hj6PrJ
February 7, 2025 at 12:14 PM
Curious about "Why 🚀", you may wonder?
smolagents effortlessness combined with the power of 400,000 AI tools available on the Hub!
library: https://buff.ly/4hj6PrJ
smolagents effortlessness combined with the power of 400,000 AI tools available on the Hub!
library: https://buff.ly/4hj6PrJ
WOW, this will rock the world! Hibiki is a model for simultaneous speech2speech translation.
And it actually works.
Available in French-English but super excited to see what the community will do.
Hub: https://buff.ly/3EtmM0f
Paper: https://buff.ly/4jIXNGd
And it actually works.
Available in French-English but super excited to see what the community will do.
Hub: https://buff.ly/3EtmM0f
Paper: https://buff.ly/4jIXNGd
February 6, 2025 at 3:06 PM
WOW, this will rock the world! Hibiki is a model for simultaneous speech2speech translation.
And it actually works.
Available in French-English but super excited to see what the community will do.
Hub: https://buff.ly/3EtmM0f
Paper: https://buff.ly/4jIXNGd
And it actually works.
Available in French-English but super excited to see what the community will do.
Hub: https://buff.ly/3EtmM0f
Paper: https://buff.ly/4jIXNGd
Agentic RAG: Applied, visual, and step-by-step! 🐾
Get familiar with the Agents and tools, not the bells and whistles!
Retrieve - Augment and now GENERATE.
Parts:
1: https://buff.ly/40XNIxM
2: https://buff.ly/40HkB0x
3:
Get familiar with the Agents and tools, not the bells and whistles!
Retrieve - Augment and now GENERATE.
Parts:
1: https://buff.ly/40XNIxM
2: https://buff.ly/40HkB0x
3:
Agentic RAG Stack (3/5) - Generate responses using a SmolLM
A Blog post by David Berenstein on Hugging Face
buff.ly
February 6, 2025 at 9:47 AM
Agentic RAG: Applied, visual, and step-by-step! 🐾
Get familiar with the Agents and tools, not the bells and whistles!
Retrieve - Augment and now GENERATE.
Parts:
1: https://buff.ly/40XNIxM
2: https://buff.ly/40HkB0x
3:
Get familiar with the Agents and tools, not the bells and whistles!
Retrieve - Augment and now GENERATE.
Parts:
1: https://buff.ly/40XNIxM
2: https://buff.ly/40HkB0x
3:
🤯 Bring your own AI data, even if you have none!
Describe your dataset for RAG, LLMs or Text Classification
Bring your own context!
Press play and wait
Space: https://buff.ly/3Y1S99z
GitHub: https://buff.ly/49IDSmd
Describe your dataset for RAG, LLMs or Text Classification
Bring your own context!
Press play and wait
Space: https://buff.ly/3Y1S99z
GitHub: https://buff.ly/49IDSmd
February 6, 2025 at 8:00 AM
🤯 Bring your own AI data, even if you have none!
Describe your dataset for RAG, LLMs or Text Classification
Bring your own context!
Press play and wait
Space: https://buff.ly/3Y1S99z
GitHub: https://buff.ly/49IDSmd
Describe your dataset for RAG, LLMs or Text Classification
Bring your own context!
Press play and wait
Space: https://buff.ly/3Y1S99z
GitHub: https://buff.ly/49IDSmd
Anyone can create free hosted tools for their AI agents! 🔥
Agentic RAG stack part 2 - augment
Augment retrieval results by reranking optimises content without increasing time too much
part2: https://buff.ly/40HkB0x
part1: https://buff.ly/40XNIxM
code: https://buff.ly/4hEajpj
Agentic RAG stack part 2 - augment
Augment retrieval results by reranking optimises content without increasing time too much
part2: https://buff.ly/40HkB0x
part1: https://buff.ly/40XNIxM
code: https://buff.ly/4hEajpj
February 5, 2025 at 10:11 AM
Anyone can create free hosted tools for their AI agents! 🔥
Agentic RAG stack part 2 - augment
Augment retrieval results by reranking optimises content without increasing time too much
part2: https://buff.ly/40HkB0x
part1: https://buff.ly/40XNIxM
code: https://buff.ly/4hEajpj
Agentic RAG stack part 2 - augment
Augment retrieval results by reranking optimises content without increasing time too much
part2: https://buff.ly/40HkB0x
part1: https://buff.ly/40XNIxM
code: https://buff.ly/4hEajpj
🔥 How to find and install the latest AI apps from the AI app store
1. go to https://buff.ly/42CnUbU
2. search the app you like
3. go to the bottom settings
4. open the URL
5. press the search bar to install
More info: https://buff.ly/3Csqc2J
1. go to https://buff.ly/42CnUbU
2. search the app you like
3. go to the bottom settings
4. open the URL
5. press the search bar to install
More info: https://buff.ly/3Csqc2J
February 5, 2025 at 7:40 AM
🔥 How to find and install the latest AI apps from the AI app store
1. go to https://buff.ly/42CnUbU
2. search the app you like
3. go to the bottom settings
4. open the URL
5. press the search bar to install
More info: https://buff.ly/3Csqc2J
1. go to https://buff.ly/42CnUbU
2. search the app you like
3. go to the bottom settings
4. open the URL
5. press the search bar to install
More info: https://buff.ly/3Csqc2J