🧵 [3/n] 📚Our data synthesis framework uses reference-level feedback to guide the synthesis of new instructions as well as improve their corresponding responses. We present REFED, a dataset consisting of 10K samples synthesized using our framework.
February 10, 2025 at 3:56 PM
🧵 [3/n] 📚Our data synthesis framework uses reference-level feedback to guide the synthesis of new instructions as well as improve their corresponding responses. We present REFED, a dataset consisting of 10K samples synthesized using our framework.
🧵 [2/n] Our key insight 🎯 We extract valuable feedback from high-quality reference samples to guide data synthesis. This effectively leverages seed datasets, propagating desirable qualities to newly synthesized data.
February 10, 2025 at 3:56 PM
🧵 [2/n] Our key insight 🎯 We extract valuable feedback from high-quality reference samples to guide data synthesis. This effectively leverages seed datasets, propagating desirable qualities to newly synthesized data.
💡 Introducing Reference-Level Feedback: A new paradigm for using feedback to improve synthetic data!
🌐 shuhaibm.github.io/refed/
🧵 [1/n]
🌐 shuhaibm.github.io/refed/
🧵 [1/n]
February 10, 2025 at 3:56 PM
💡 Introducing Reference-Level Feedback: A new paradigm for using feedback to improve synthetic data!
🌐 shuhaibm.github.io/refed/
🧵 [1/n]
🌐 shuhaibm.github.io/refed/
🧵 [1/n]