Teacher flask: a 235B model run on GPU compute235B total · 22B activeStudent flask: the distilled, quantized model30B total · 3B activeteacher modelGPU heatquantization condenserwater inwater outdistilled weightsstudent modellab bench
A metaphor, not chemistry: quantization drawn as distillation. The apparatus is invented; the numbers are real and cited below.