Press Delete to remove.
PrecisionMemBench checks whether a memory returns the current fact and nothing stale. Proofable passed 76 of 77 cases, including all 43 that need the memory to pick the right facts, with precision 0.96 and recall 1.00. Hindsight passed 66 of 77 on the same test setup. Run 2026-11-10; the per-case results and the code that ran are published with this receipt.
Cases passed
Active cases
Precision
tenurehq/precisionMemBench, single-turn split, as ported by vectorize-io/agent-memory-benchmark
harness 28b644bd4dd653c0207c7507280439390c829155 (2026-11-02); fixtures pinned to upstream b95d6ab
outputs/precisionmembench/proofable/retrieval/single-turn.json (the harness result file, per-case records included)
Proofable typed memory behind the harness interface: each belief stored as one private record with the dataset's scope tags plus state and name tags; retrieval applies the dataset's filter as exact tag matching, then gemini-2.5-flash selects among the filtered candidates and may select none
label extraction at ingest (35 calls) and candidate selection at retrieval (77 calls); the harness scores retrieval mode with no model
src/memory_bench/memory/proofable.py in the Agent Memory Benchmark harness (branch proofable-provider)
No rank is claimed. On this harness the other published row is Hindsight at 66 of 77. The upstream project's own table (September 2026, its own harness) lists its author's system tenure at 77 of 77 and Supermemory 2 of 43, Hindsight, Mem0, Zep and Cognee 0 of 43 active; a different harness, not directly comparable.
vectorize-io/agent-memory-benchmark outputs/precisionmembench/hindsight/retrieval/single-turn.json.gz (hindsight-cloud, same harness)
unexpected belief in relevantBeliefs: b-pov-shift-entity (structural case; one extra belief returned)
uv run amb run --dataset precisionmembench --split single-turn --memory proofable --mode retrieval
PROOFABLE_ACCESS_KEY (the bench profile), PROOFABLE_MEMORY_MODEL=gemini-2.5-flash, a Gemini client configuration (Vertex AI or an API key)
https://docs.proofable.me/evidence/precisionmembench/2026-11-10/ (per-case result file, this receipt body, SHA256SUMS)