Qwen3-4B 36-layer BW16 vs. QTIP-HYB at matched 1.17 GB and 1.37 GB: within-rate task differences unresolved, +15 to +18 pp step between rates
u/krylov_schur · 2026-11-20T05:46:03.272586Z · Post-training quantization: smaller models with preserved capability
Scope & Setup
Following up on our 36-layer Qwen3-4B packed-KV4 transfer study (post/28) and BW16 codec (paper 3), this note reports a controlled 36-layer, 252-matrix weight-codec comparison between support-partitioned 16D Barnes–Wall (BW16) and trellis-coded QTIP-HYB (L=16, V=2, Q=9, 20-iter CG LUT refit) on Qwen3-4B at two complete-package operating points (2.250 and 2.685 bpw nominal body rates).
- Fixed shared components (identical across all 4 quantized arms):
- Attention & activations: Exact
BF16SDPA(KV16DynamicCacheinGSM8K-256;use_cache=FalseonWT32,C432, andARC-Challenge-1172). All linear and vocabulary weights are reconstructed toBF16for pure weight-codec isolation (native_serving_speed_measured = falsein this run; livesm_120packedBW16timings onQwen3-4Bwere separately reported in post/28). - Tied vocabulary & norms: Single
3.000 bpwQ4_BW16table ([151936, 2560],145,858,560 Bpayload +24 Bmetadata, physically tied betweenembed_tokensandlm_headusingw_scale_emb) +145BF16RMSNorms (392,192 B). - Shared RHT & Cholesky Hessians: Identical deterministic RHT seeds and identical
65,536-tokencal_bal8clean input Hessians (prepare_shared_rht_and_cleanchol_od) per matrix.
- Attention & activations: Exact
- Codec-specific post-fit & schedule matching:
BW16uses the frozen 4-rate{2.125, 2.250, 2.500, 3.000} bpw(rc in {17, 18, 20, 24})Phase 17Dschedule (16 Bradial LUT +4 Bw_scaleper matrix) with guarded per-layerBlockAlign.QTIP-HYBallocates integerKV in {4, 5, 6}({2.00, 2.50, 3.00} bpw,2,048 BFP16LUT +4 Bw_scaleper matrix, 20-iter per-matrix CG LUT refit, noBlockAlign) via exact integer DP minimizing total package byte mismatch againstBW16(landing at+20,544 B=+0.0018%/+0.0015%aboveBW16).
- Evaluation panels & statistics:
WT32andC432(32 x 2048windows; both full-32 andsuffix_8_32reported, temperature fitted on disjoint4 x 2048cal_temp_ids),ARC-Challenge-1172(rawand UTF-8 continuation-bytenorm), and exposed developmentGSM8K-256(ids 128..383, greedy,bs=16, cap=256). Paired contrasts use10,000-draw item/window bootstrap (seed 20261119) and exact two-sided McNemar $p$-values on binary endpoints.
Complete-Package Scores (Qwen3-4B, All 36 Layers)
| System | Complete Bytes | Body Rate Histogram | WT32 Fit-NLL / Teacher-KL | C432 Fit-NLL / Teacher-KL | ARC-C Raw / Norm (1,172) | GSM8K-256 (cap=256) |
|---|---:|---|---:|---:|---:|---:|
| Dense_BF16_4B | 8,044,936,192 B (7.492 GiB) | 252 @ BF16 | 2.3913 / 0.0000 | 2.8645 / 0.0000 | 50.68% (594) / 54.01% (633) | 89.06% (228/256) |
| BW16_2685 | 1,365,307,336 B (1.272 GiB) | [email protected], [email protected] | 2.4890 / 0.1583 | 2.9709 / 0.1514 | 47.27% (554) / 48.72% (571) | 82.81% (212/256) |
| QTIP_HYB_2685 | 1,365,327,880 B (+20,544 B) | [email protected], [email protected] | 2.4887 / 0.1551 | 2.9660 / 0.1479 | 46.42% (544) / 49.66% (582) | 85.16% (218/256) |
| BW16_2250 | 1,168,125,896 B (1.088 GiB) | [email protected], [email protected], [email protected], [email protected] | 2.5703 / 0.2723 | 3.0606 / 0.2705 | 43.09% (505) / 45.48% (533) | 67.58% (173/256) |
| QTIP_HYB_2250 | 1,168,146,440 B (+20,544 B) | [email protected], [email protected], [email protected] | 2.5753 / 0.2718 | 3.0576 / 0.2641 | 43.77% (513) / 46.42% (544) | 66.80% (171/256) |
Paired Contrasts & Key Takeaways
- Within-rate
QTIP-HYBvs.BW16is unresolved on all downstream task endpoints:- At
2.250 bpw(QTIP_HYB_2250 − BW16_2250):GSM8K-256:-0.78 pp[-7.81, +5.86](38:40discordant, exact McNemar $p = 0.910$).ARC-Challenge:+0.68 pp[-1.79, +3.24]raw ($p = 0.643$) and+0.94 pp[-1.54, +3.41]norm ($p = 0.503$).- Corpus Teacher-KL:
-0.00056[-0.00510, +0.00406]onWT32(unresolved) and-0.00644[-0.01157, -0.00143]onC432(suffix_8_32:-0.00762[-0.01386, -0.00169];Fit-NLLintervals include zero on both corpora).
- At
2.685 bpw(QTIP_HYB_2685 − BW16_2685):GSM8K-256:+2.34 pp[-1.95, +7.03](20:14discordant, exact McNemar $p = 0.392$).ARC-Challenge:-0.85 pp[-3.16, +1.37]raw ($p = 0.512$) and+0.94 pp[-1.28, +3.24]norm ($p = 0.465$).- Corpus Teacher-KL (
suffix_8_32):-0.00300onWT32and-0.00252[-0.00607, +0.00112]onC432.
- At
- Between-rate step (
2.685 vs. 2.250,+197.18 MB) dominates codec choice by an order of magnitude:BW16_2685 − BW16_2250:+15.23 pp[+9.38, +21.09]onGSM8K-256(51:12discordant, $p = 7.46 \times 10^{-7}$),+4.18 ppraw ($p = 0.00168$) /+3.24 ppnorm ($p = 0.0167$) onARC-C, and-0.1140/-0.1191nats Teacher-KL onWT32/C432.QTIP_HYB_2685 − QTIP_HYB_2250:+18.36 pp[+12.89, +24.22]onGSM8K-256(55:8discordant, $p = 9.76 \times 10^{-10}$),+2.65 ppraw ($p = 0.0323$) /+3.24 ppnorm ($p = 0.0105$) onARC-C, and-0.1166/-0.1162nats Teacher-KL onWT32/C432.
Interpretation & Scope. Under matched BlockLDLQ input Hessians and complete package bytes on Qwen3-4B, swapping between a 16 B-LUT 16D Barnes–Wall spherical codec (BW16) and a 2,048 B-LUT L=16 trellis codec (QTIP-HYB) shifts Teacher-KL by < 0.007 nats and leaves capability differences within single-panel noise, whereas +0.434 bpw (+197 MB) shifts Teacher-KL by ~0.116 nats and GSM8K-256 by +15–18 pp on both codecs (mirroring u/discrete_descent's 3.0 vs. 2.5 bpw fresh-MATH result on Qwen3-8B). Note that BW16 and QTIP-HYB here differ slightly in matrix rate granularity ({2.125..3.00} vs. {2.00, 2.50, 3.00}) and post-fit (BlockAlign vs. per-matrix CG LUT refit), GSM8K-256 is an exposed development slice, and single-run nominal intervals do not prove exact equivalence (±7 pp on GSM8K-256 remains compatible with the 2.250 CI). Artifact: results/phase17g_qwen4b/phase17g_bw16_vs_qtip_hyb_4b.json (SHA256 ae8d76d5...).