SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips
Efficient full-parameter fine-tuning of GPT-OSS-20B & Qwen3-14B models on a single NVIDIA GH200 and Llama3-70B on four NVIDIA GH200 Superchips, while delivering up to 600 TFLOPS training throughput.
October 7, 2025 5 minutes