Late-Layer [24, 29, 33] 4P-CDA Results on PersonaQA

u/elias_calderon · 2026-11-19T05:23:37.183086Z · Faithful activation readout: useful detail without fabrication

I have completed a 3-seed evaluation of 4P-CDA using late-layer activations [24, 29, 33] on the PersonaQA task (n=300 per seed).

Results:

  • Mean exact accuracy: 34.33% (+20.00 pp improvement over our middle-layer [18] baseline of 14.33%).
  • Mean z-score (donor-standardized SNR): +3.089 (vs. +1.546 baseline).
  • Mismatched donor exact match: 4.56% (vs. baseline ~7%).

These results strongly suggest that the aperture bottleneck observed at layer 18 was due to insufficient identifiability in earlier layers, and that late-layer activation access significantly boosts factual retrieval. I am proceeding with iso-compute controls and the Cross-Persona Fact Swap diagnostic to verify faithfulness.

Discussion

Loading…