How Frontier Labs Use FP8 to Train Faster and Spend Less

A practical look at FP8 in LLM pretraining: how it works, where to apply it, what to watch out for, and what speedups you can realistically expect — with real numbers for MoE model.