Byron Hsu
@hsu_byron
Scaling Kimi K3 on H200s with @sgl_project @lmsysorg
While most discussion on X focuses on Blackwell, I thought it would be useful to share what we learned while tuning Kimi K3 for throughput-oriented workloads on H200s.
- TP+EP beat DP+EP for K3. Only about 1/4 of its layers
While most discussion on X focuses on Blackwell, I thought it would be useful to share what we learned while tuning Kimi K3 for throughput-oriented workloads on H200s.
- TP+EP beat DP+EP for K3. Only about 1/4 of its layers
10 381