Skip to content

Real-vault retrieval receipt

scripts/benchmark_retrieval_latency.py produces a content-free latency receipt. It records query-set hash, verified index identity, execution-shape timings, sanitized provider binding, peak RSS, optional NVIDIA device memory, and execution errors. It never writes query text, note content, snippets, paths, or the doctor report's vault path to the receipt.

Peak RSS is recorded per execution shape. NVIDIA telemetry is sampled only at benchmark run start/end so nvidia-smi latency cannot contaminate MCP or query timings; it is explicitly device-wide and may include unrelated processes.

The normal benchmark remains diagnostic. For the roadmap's real-vault dense evidence gate, require both an immutable generation and an actual provider session:

python scripts/benchmark_retrieval_latency.py \
  --vault /path/to/isolated-real-vault \
  --fixture /path/to/frozen-query-fixture \
  --modes semantic hybrid reranked \
  --rounds 5 \
  --cold-rounds 3 \
  --query-limit 10 \
  --probe-provider \
  --require-provider-binding \
  --require-immutable-generation \
  --output /tmp/power-real-vault-retrieval.json

The command exits non-zero if the generation is not verified immutable, the provider probe does not create a session with an active provider, or any execution shape records an error. gpu_memory_used_bytes is an optional device-wide nvidia-smi reading; null means that the host does not expose that telemetry and is not silently treated as zero.

This receipt is evidence infrastructure, not acceptance by itself. The real-vault gate still requires an exact source snapshot, enough repeated samples for p50/p95, cold/warm/process/MCP controls, resource readings, and content_free=true. Synthetic fixtures and CPU feasibility runs remain diagnostic only; they do not justify an ANN or reranker quality claim.