On February 28, 2025, DeepSeek made significant strides in the open-source community by launching the Fire-Flyer File System (3FS) and the Smallpond data processing framework. These innovations are designed to enhance data access and processing capabilities, particularly for AI training and inference workloads. Fire-Flyer File System (3FS) The Fire-Flyer File System (3FS) is a high-performance […]

Learn about DeepEP by DeepSeek, providing efficient communication solutions for MOE models with strong community support.

Meetings with the NYC Civic Engagement Commission and GovLabOn Monday, we met with our colleagues from the Civic Engagement Commission (CEC) at New York City Hall. It was a pleasure to connect with su...

Learn how FlashMLA revolutionizes AI hosting with advanced multi-latent attention technology for Hopper GPUs.

Discover DeepSeek DeepGEMM, the new library optimizing FP8 General Matrix Multiplications for AI training and inference.

As part of the ongoing #OpenSourceWeek, DeepSeek announced the release of DeepGEMM, a cutting-edge library designed for efficient FP8 General Matrix Multiplications (GEMMs). This library is tailored to support both dense and Mix-of-Experts (MoE) GEMMs, making it a powerful tool for V3/R1 training and inference. With DeepGEMM, we aim to push the boundaries of performance […]

DeepSeek is here with its Day 2 of #OpenSourceWeek and today they introduced DeepEP – An open Source EP communication library for MOE model training and inference. Till now, I have been completely impressed by DeepSeek and their answer to the billion-dollar models of OpenAI, Meta and more. Now, they are open-sourcing the building blocks […]

TL/DR: Use this form to register for the April 9, 2025 SciCodes Research Software Symposium: "Building the Future of Research Software". The survey has two sections: questions on general information a...

Learn about the advancements in Optimized Parallelism Strategies that boost deep learning performance and resource efficiency.

DeepSeek's 3FS & Smallpond framework, revolutionizing AI data access & processing with high-performance storage & scalable computing.

As we reach Day 6 of #OpenSourceWeek, DeepSeek presented an in-depth overview of the DeepSeek-V3/R1 inference system. This article will dig into the system’s design principles, optimization strategies, and performance statistics, highlighting the significant advancements made in throughput and latency optimization. System Design Principles The primary objectives of the DeepSeek-V3/ DeepSeek R1 inference system are […]

As part of #OpenSourceWeek Day 4, DeepSeek introduces 2 new tools to make deep learning faster and more efficient: DualPipe and EPLB. These tools help improve how computers handle calculations and communication during training, making the process smoother and quicker. In the fast-changing world of deep learning, finding ways to train models better while using […]