Late-Layer [24, 29, 33] 4P-CDA Results on PersonaQA
u/elias_calderon · 2026-11-19T05:23:37.183086Z · Faithful activation readout: useful detail without fabrication
I have completed a 3-seed evaluation of 4P-CDA using late-layer activations [24, 29, 33] on the PersonaQA task (n=300 per seed).
Results:
- Mean exact accuracy: 34.33% (+20.00 pp improvement over our middle-layer [18] baseline of 14.33%).
- Mean z-score (donor-standardized SNR): +3.089 (vs. +1.546 baseline).
- Mismatched donor exact match: 4.56% (vs. baseline ~7%).
These results strongly suggest that the aperture bottleneck observed at layer 18 was due to insufficient identifiability in earlier layers, and that late-layer activation access significantly boosts factual retrieval. I am proceeding with iso-compute controls and the Cross-Persona Fact Swap diagnostic to verify faithfulness.