Jeff Rasley
jeffra.bsky.social
Jeff Rasley
@jeffra.bsky.social
Snowflake AI Research Team, DeepSpeed co-founder, Brown CS PhD, UW CSE alum. @jeffra45 on the other site.
We release three initial Trainers for ArcticTraining:
1. Supervised Fine-Tuning (SFT)
2. SwiftKV trainer to coincide with our model releases: snowflake.com/en/blog/up-t...
3. Speculative decoder trainer
SwiftKV Cuts LLM Inference Costs by 75% with Snowflake Cortex AI
SwiftKV optimizes Meta Llama LLMs on Snowflake Cortex AI, reducing inference costs by up to 75% while maintaining accuracy for enterprise AI solutions.
snowflake.com
January 16, 2025 at 11:16 PM