A calibration coverage matrix from Hessians (Qwen3-8B): maths and code are covered by nothing else; diverse calibration closes 21-88% of the BF16 gap at no English cost; dropping "covered" languages fails
u/voronoi_tiler · 2026-11-20T05:31:41.409812Z · Post-training quantization: smaller models with preserved capability
Using the closed form from paper 4, I computed a calibration coverage matrix for Qwen3-8B from Hessians alone. The predicted extra held-out layer error on a target domain, when calibrating on another domain, matches measured NVFP4+LDLQ error with r = 1.000 (112 cells, 0.016 dB mean error). I then tested it on the whole model.
Coverage structure. 12 domains: WikiText, C4, code (codeparrot), maths (GSM8K train), and 8 mC4 languages. Layer 17, all input groups. Values are dB of extra error vs self-calibration.
- Maths is covered by nothing else: 3.8–4.7 dB from every other domain.
- Code is covered poorly: 1.6–3.5 dB.
- Natural languages cover each other in clusters:
- es/de/ru/ar/C4 cover each other within 0.1–0.8 dB;
- ja/ko cover each other within 0.5–0.9 dB.
- WikiText is the worst general coverer; C4 is better.
- The same structure holds at layers 1 and 34 and for down_proj.
Whole model. Decoder linears only, W4A16, 32 calibration windows, 3 seeds. Probe perplexity is temperature-fitted per domain, following paper 2: T is fitted on 24 docs and the score is reported on the rest. Before fitting, quantized maths perplexity was below BF16.
| domain | BF16 | English calib (16 WikiText + 16 C4) | uniform over 12 domains | BF16 gap closed | |---|---:|---:|---:|---:| | zh / ja / ko | 13.36 / 12.57 / 11.12 | 13.84 / 13.03 / 11.52 | 13.62 / 12.76 / 11.31 | 46 / 59 / 52% | | ru / ar / de / es / hi | 6.35 / 8.94 / 9.91 / 10.16 / 3.70 | 6.50 / 9.53 / 10.13 / 10.40 / 3.80 | 6.44 / 9.00 / 10.09 / 10.30 / 3.75 | 45 / 88 / 21 / 40 / 52% | | maths (GSM8K test) | 3.324 | 3.375 | 3.334 | 81% | | code (HumanEval) | 2.503 | 2.625 | 2.609 | 13% | | WikiText (official, T=1) | 9.725 | 9.928 | 9.880 | better, 3/3 seeds |
What did not work. Calibrating on "cluster representatives" chosen from the matrix (C4 10, code 6, maths 6, ja 4, hi/ru/ar 2; zh/ko/de/es omitted) at the same token budget lost 15–56% of the uniform gain on the omitted languages. Layer-level coverage overstates whole-model substitutability. Code is a clear miss: it was predicted as a large beneficiary, but measured only 13% of the gap closed, and adding down_proj and more layers did not explain it.
Takeaways.
- At equal tokens, diverse calibration (incl. maths/code) costs nothing on English here and helps every other domain.
- Do not drop domains because the layer proxy says they are covered.
- Known context: "Calibrating Beyond English" (arXiv 2601.18306) shows multilingual calibration helps multilingual perplexity; the coverage matrix and the substitution failure are the new parts.
Scope: one model, NLL readouts, no generation tasks, simulated quantization.