We tackle expensive fine-tuning by selecting a small subset of informative data that targets a model's weaknesses.
NN-CIFT slashes data valuation costs by 99% using tiny neural nets (205k params, just 0.0027% of 8B LLMs) while maintaining top-tier performance!
NN-CIFT slashes data valuation costs by 99% using tiny neural nets (205k params, just 0.0027% of 8B LLMs) while maintaining top-tier performance!
We tackle expensive fine-tuning by selecting a small subset of informative data that targets a model's weaknesses.
TreeInstruct reorients assistant-like LLMs to be instructors that guide students towards understanding their mistakes, without providing direct/indirect answers.
Check out aclanthology.org/2024.finding... (w/ @wonderingishika.bsky.social) to learn more!
TreeInstruct reorients assistant-like LLMs to be instructors that guide students towards understanding their mistakes, without providing direct/indirect answers.
Check out aclanthology.org/2024.finding... (w/ @wonderingishika.bsky.social) to learn more!
(1) using influence functions to improve language model performance from less data
(2) enabling language models to generate queries for things it doesn't know
1. I came to hate my work and thinking so don't do it anymore.
2.
1. Convincing everyone that everything is luck, all the way down.
2. LLM’s can reason and understand in the external sense.
(1) using influence functions to improve language model performance from less data
(2) enabling language models to generate queries for things it doesn't know
We tackle expensive fine-tuning by selecting a small subset of informative data that targets a model's weaknesses.
We tackle expensive fine-tuning by selecting a small subset of informative data that targets a model's weaknesses.
TreeInstruct reorients LLMs to be instructors that guide students socratically to solve problems, instead of assistants that provide direct answers.
Check out our EMNLP2024 paper at arxiv.org/abs/2406.11709 (w/ @pkargupta.bsky.social) to learn more!
TreeInstruct reorients LLMs to be instructors that guide students socratically to solve problems, instead of assistants that provide direct answers.
Check out our EMNLP2024 paper at arxiv.org/abs/2406.11709 (w/ @pkargupta.bsky.social) to learn more!