DeepSeek released a series of optimized parallel strategies on the fourth day of Open Source Week, including Dual Pipeline (a bidirectional pipeline parallel algorithm that optimizes computation-communication overlap in V3/R1 training), EPLB (Expert Parallel Load Balancer, which improves the efficiency of computing resource allocation), and a computation-communication overlap analysis tool to help optimize training performance.

PANews reported on February 27 that according to DeepSeek (@deepseek_ai), on the fourth day of Open Source Week, the team open-sourced a number of optimized parallel strategies, including DualPipe (bidirectional pipeline parallel algorithm, optimizing compute-communication overlap in V3/R1 training), EPLB (Expert Parallel Load Balancer, improving the efficiency of computing resource allocation) and compute-communication overlap analysis tools to help optimize training performance.

DeepSeek has released an optimized parallel strategy, introducing DualPipe and EPLB.