Where the 384 experts live
EP8 · 8 GPUs
EP64 · 64 GPUs
Experts each GPU reads per step
7
Slowest GPU vs average
1.00×
Make one expert hot
Run EPLB
Drag to turn · scroll to zoom