Moonshot allegedly trains 3T parameter models using 20k GPU clusters

Reports suggest Moonshot's Kimi 3 architecture enables training state-of-the-art 3T parameter models on only 20,000 Nvidia GPUs. This efficiency contrasts with larger competitors attempting to build 1T parameter models using significantly larger compute clusters.