Repository navigation
Corpus changed under us - what does the pinning actually verify? #7
Answered
by
maxgregaabig
camillejackson
asked this question in
Q&A
|
Our probe corpus was edited without anyone noticing and the per-class rates moved silently. What does the integrity check verify, and when is re-pinning correct? |
Answered by
maxgregaabig
Sep 28, 2026
Replies: 1 comment
|
The integrity check records the corpus hash with every run and treats a mismatch against the pinned hash as a usage error, not a silent comparison. Re-pin only when the change is intentional: review the added or edited probes, update the pinned hash in the same commit, and rerun both guards so the deltas are computed on the same corpus. Same probes, same order, same hash is what makes a delta a real guard change. |
0 replies
Answer selected by
camillejackson
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The integrity check records the corpus hash with every run and treats a mismatch against the pinned hash as a usage error, not a silent comparison. Re-pin only when the change is intentional: review the added or edited probes, update the pinned hash in the same commit, and rerun both guards so the deltas are computed on the same corpus. Same probes, same order, same hash is what makes a delta a real guard change.