Rémi Paccou
remipaccou.bsky.social
Rémi Paccou
@remipaccou.bsky.social
Researcher, Publisher, Musician.
Intersecting Energy, Digital and Climate.
Author of System Dynamics of AI and Electricity.
PhD at CIRED. Arts et Métiers.
#EnergyTransition #AI #InformationTheory #Economics #HistoryofEnergy #Sustainability

1️⃣ Holistic Efficiency
🔋 Algorithmic + Energy Synergy: DeepSeek's GRPO reduced training costs by 42.5%, while our projections show 70% annual TFLOPs gains through hardware/software co-design.
🌱 Frugality: DeepSeek's "cold-start" data (thousands vs. millions of examples) to curb overparameterization
January 28, 2025 at 12:40 PM
2️⃣ Purpose-Driven Design
🎯 Model Efficiency: DeepSeek's distilled 14B model outperforming 32B benchmarks aligns with our 30x energy savings via task-specific models.
⚡ Inference Optimization: 93.3% KV cache reduction complements our 40% edge computing savings, smaller can be smarter.
January 28, 2025 at 12:39 PM
3️⃣ Ecosystem Collaboration
🔓 Open Innovation: DeepSeek's 6 open-source models resonate with our push for industry-wide certification standards.
🔄 Symbiotic Systems: DeepSeek's RL-driven self-evolution towards AI-optimized energy systems, creating feedback loops between algorithms and infrastructure.
January 28, 2025 at 12:38 PM