Repository navigation
Conversation
- Unprovable from code is not wrong; reverify needs a separate signal for claims the evidence contradicts
- A claim code cannot prove is not wrong; age alone no longer archives a memory that was checked and found inconclusive - v8 clears reverified_at: earlier checks asked only the support question
- 0.8 is the lowest grid value with no false contradiction on the presumed-true set; lower values contradicted real memories
Verdenroz
temporarily deployed
to
soothfast-bot
November 6, 2026 15:30 — with 
GitHub Actions
Inactive
GitHub Actions
Inactive
Verdenroz
temporarily deployed
to
soothfast-bot
November 6, 2026 15:32 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Contributor
soothfast gatescry-core |
Verdenroz
temporarily deployed
to
soothfast-bot
November 6, 2026 15:43 — with
GitHub Actions
Inactive
GitHub Actions
Inactive
Contributor
soothfast verdict4 projects: 0 regressed, 0 errored, 4 pass docspass | docs | 0s pythonpass | import | 9s scry-corepass | rust | 6s test-rustpass | test | 21s |
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Reverify asked only whether the current code supports a stale memory, and a code chunk cannot support a claim like "Valgrind dies with SIGILL on this machine". In a dry run on the live index it reaffirmed 0 of 5, which as shipped meant marking true memories failed and archiving them after 14 days. Reverify now also asks whether the code contradicts the claim. Only a contradiction lets gc archive early, and a memory that comes back inconclusive is never archived on age. At the calibrated default the contradiction check flags nothing yet, so in practice this is the safe half of the design until a better prompt or model separates the two.
Changes
ClaimScorerinverify.rs, with its own chat prompt and SystemOne question.config.promptstill applies only to the support question.[verify] contradiction_threshold, default 0.8.reverifyto score support first, then contradiction. Support reaffirms, contradiction stampscontradicted_at, and anything else stamps onlyreverified_at. The report gained acontradictedcount.contradicted_atcolumn. The migration clearsreverified_at, since earlier checks asked only the support question.gc_stale_days. One checked and found inconclusive is kept.gc_stale_daysdefault to 30.eval/contradiction-pairs.jsonl: 22 presumed-true and 6 hand-edited contradicted pairs from this repo's own memories.docs/memory.md.Breaking Changes
Schema moves from v7 to v8 and migrates on
Store::open. Back upindex.dbbefore deploying.Testing
Calibration with
qwen3.6:35b-a3bover 91 presumed-true pairs (77 live stale memories with indexed evidence, 14 good pairs fromverify-pairs.jsonl) and 27 hand-edited contradicted claims:The highest-scoring true memory and the highest-scoring edited claim both scored 0.76. The committed file holds only the rows built from this repo's content.
Checks run:
cargo test -p scry-corecargo test -p scry-servercargo test -p scrycargo clippy --workspace --all-targets -- -D warningscargo fmt --all --check