Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) #415

Open
opened 2026-09-24 03:39:00 +01:00 by conductor · 15 comments
Owner

CLOSED — RESEARCH COMPLETE, IMPLEMENTATION DEFERRED (parent disposition on #356).

Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanisms: findings in the corpus (research/). The non-LLM mechanism principle is already the repo's operating law in shipped form: deterministic Rust cores (hash chains, RRF fusion, promotion gates, the 16-edge phase machine — all zero-LLM, CI-verified). Deeper algorithmic findings defer. Harness invariants landed via #411.

CLOSED — RESEARCH COMPLETE, IMPLEMENTATION DEFERRED (parent disposition on #356). Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanisms: findings in the corpus (research/). The non-LLM mechanism principle is already the repo's operating law in shipped form: deterministic Rust cores (hash chains, RRF fusion, promotion gates, the 16-edge phase machine — all zero-LLM, CI-verified). Deeper algorithmic findings defer. Harness invariants landed via #411.

⚠️ Priority gate: this issue has no priority. Assign exactly one of P0 — critical (spine/correctness/blocks), P1 — high (material value or real defect), P2 — medium (quality/consolidation), P3 — low (measurement/deferred). An issue without a priority is not filed.

⚠️ **Priority gate:** this issue has no priority. Assign exactly one of **P0 — critical** (spine/correctness/blocks), **P1 — high** (material value or real defect), **P2 — medium** (quality/consolidation), **P3 — low** (measurement/deferred). An issue without a priority is not filed.
Author
Owner

Tranche opened. Scope: research/memory-atlas-r1/AH-mechanisms-atlas/00_issue_scope.md — 26 mechanism families (arms A–Z), mechanism-supply question, Registry + Forge + compilation-ladder designs required, consolidation pressure explicit. Research-only; LOCAL_MODEL_COMPUTE_EXECUTED = NO.

Tranche opened. Scope: research/memory-atlas-r1/AH-mechanisms-atlas/00_issue_scope.md — 26 mechanism families (arms A–Z), mechanism-supply question, Registry + Forge + compilation-ladder designs required, consolidation pressure explicit. Research-only; LOCAL_MODEL_COMPUTE_EXECUTED = NO.
Author
Owner

#415 AH — SEALED ✅ 8ef5486 (R1_QUALIFIED, R1_FULL)

Seal commit: 8ef54869e4129ded18c0bd35596dc62249153fdd — pushed origin + gitea, mirrors verified identical, tracked research state clean, mutation audit written LAST. Token: MEMORY_ATLAS_R1_AH_SEALED

MECHANISM ATLAS — research only. LOCAL_MODEL_COMPUTE_EXECUTED = NO · no implementation, no production mutation, no installs. Arm 7 performed read-only isolated LOCAL CPU MEASUREMENTS (compression on Rune corpora; SQLite micro-benchmarks) — recorded as RUNE APPLICABLE evidence. Nine serial arms (8 research + independent fresh-context red team).

HEADLINE: FIT-NARROWED

Red team: 51 attacks (21 SUCCEEDS / 22 PARTIAL / 7 FAILS / 1 UNKNOWN), 16 mandatory repairs applied. The REJECT set independently survived attack (e-graphs, graph engine, WITHOUT ROWID, minimal S4 set, information-theory split, verification honesty — attacks repelled).

EXECUTIVE: most of what Rune defers to a frontier model is bounded computation — classification, routing, scheduling, constraint satisfaction, drift detection, query assembly, protocol enforcement. The atlas is not free: the union of eight arms implies ~40 dependencies for one operator, only one arm produced Rune-local measurement, and the composition law is unsatisfiable at Rune's data rates as originally stated. Phase-1 is therefore a narrow core with local measurement.

PHASE-1 CORE (8 deps): sklearn (HGB + elastic-net) · MAPIE/crepes (conformal) · OR-Tools (CP-SAT) · HiGHS (MILP) · zstd · PM4Py+Woflan · Hypothesis+mutmut · uid-separated Ed25519 signer.

PRODUCED the two artefacts the red team found MISSING: the Mechanism Registry schema (contracts, determinism, costs including operator-minutes, sample needs, OOD behaviour, abstention + guarantee + assumptions, failure modes, applicability envelope, verification, rollback, dependencies, qualification status, escalation counter, evidence class) and the Mechanism Forge design (contract → verified-outcome dataset with grader ≠ generator → candidates → held-out/OOD/adversarial/resource eval → Pareto → shadow → QUALIFY → monitor; legitimate exit = keep richer cognition, logged so the substitution goal stays falsifiable).

Key verdicts

HGB default + elastic-net fallback (XGBoost de-privileged on evidence, reverse-incumbent risk named and attacked) · batch-retrain beats continuous adaptation (linear-only online; Nature 2024 plasticity loss) · exactly two genuine bandit problems (routing, retrieval) + DR-OPE harness — deadlocked without ε-randomised logging · expert-structured BNs gated EXPERIMENT (structure learning REJECT) · conformal stack recalibrate→split→adaptive→OOD gate plus a guarantee state machine (monitor + un-void + abstain ceiling) — otherwise the attractor is permanent abstention · solver shelf CP-SAT/HiGHS/Z3 with extract-solve-verify and an independent checker (VPU 2609.11085: verdict-only checking cannot detect bad encodings ⇒ operator-owned specs ≤50 lines) · FF-Replan for nondeterminism · OR formulations exact-affordable (LP/knapsack/assignment/MILP/RCPSP) · graph engine REJECT before S3 · Count-Min (overestimation = conservative for escalate-rules) + HyperLogLog + reservoir adopted, Bloom-family measurement-gated · compilation ladder L1–L6 evidenced (2–15×) / L7 partial-evaluation-of-reasoning UNEVIDENCED · e-graphs REJECT-now/FUTURE-triggered · the verifier (not the generator) buys synthesis reliability · atomic decision boundary (OPA/Cedar provably non-atomic under concurrency) · minimal control set = 5 mechanisms with no plant model (PID/MPC/model-based-FDD REJECT) · detector ensemble preserves precision + explicit interpretation split.

Measured locally (arm 7): partial indexes 33× smaller on rare predicates · expression indexes ~170× on JSON tag filtering · FTS5 external-content 4.76× smaller · JSONB 1.29× · zstd+110 KB trained dictionary lifts small-record compression 3.38×→5.08× · WITHOUT ROWID is a LOSS (+24%) for hash-PK ledgers.

Crypto: hash everything integrity-relevant; sign only the audit head with a uid-separated Ed25519 key (protects against a compromised Rune process, not the operator — exactly the #402 adversary); Merkle-DAG memory, transparency-log architecture and verifiable computation all REJECT (250× prover overhead; flip condition = asymmetric information, not distance).

Never-covered families found (arm Z): agentic process mining (top pick — sequence BEFORE hand-authored automata), decision-theoretic control of computation/EVOI, compensated & streaming numerics, robust statistics, real-time scheduling, RDMDU, discrete-event simulation, abstract interpretation.

Row truth: sources 213/147 gate-unique (194 builder) /14 dup groups · applicability 66 · qualification 24 · adversarial 51 · claims 12 · innovation 8 · r0 8 (7 CONFIRMED/1 REFINED) · SEARCH_SATURATION=REACHED · LOAD_BEARING_DEPTH=PASS · 0 mis-pairings shipped (17 caught in-arm; atlas cumulative 42).

Flags: LOCAL_MODEL_COMPUTE_EXECUTED = NO · LOCAL_MEASUREMENT_EXECUTED = YES (read-only) · RUNE_GROWTH_DELTA_DEFINITION = v1.1 preserved · CANONICAL_MEMORY_WRITE = 0 · DERIVED_MEMORY_WRITE = 0 · AH- gate-scope extension pre-freeze (twelve-domain regression all consistent) · sealed #396–#406, #413, #414 untouched.

RESEARCH CLOSURE: NOT YET CLOSED — one bounded synthesis pass, not a new tranche; requires E-H1 (batch-0 measurement of the existing deterministic layer) and E-H5 (SQLite mechanism A/B) to be executed. No further literature research required.

STOP. Control returned for supervisory review.

## #415 AH — SEALED ✅ `8ef5486` (R1_QUALIFIED, R1_FULL) **Seal commit:** `8ef54869e4129ded18c0bd35596dc62249153fdd` — pushed origin + gitea, mirrors verified identical, tracked research state clean, mutation audit written LAST. **Token: `MEMORY_ATLAS_R1_AH_SEALED`** **MECHANISM ATLAS — research only.** `LOCAL_MODEL_COMPUTE_EXECUTED = NO` · no implementation, no production mutation, no installs. **Arm 7 performed read-only isolated LOCAL CPU MEASUREMENTS** (compression on Rune corpora; SQLite micro-benchmarks) — recorded as RUNE APPLICABLE evidence. Nine serial arms (8 research + independent fresh-context red team). ## HEADLINE: FIT-NARROWED Red team: **51 attacks (21 SUCCEEDS / 22 PARTIAL / 7 FAILS / 1 UNKNOWN)**, 16 mandatory repairs applied. The REJECT set independently survived attack (e-graphs, graph engine, WITHOUT ROWID, minimal S4 set, information-theory split, verification honesty — attacks repelled). **EXECUTIVE:** *most of what Rune defers to a frontier model is bounded computation* — classification, routing, scheduling, constraint satisfaction, drift detection, query assembly, protocol enforcement. **The atlas is not free:** the union of eight arms implies ~40 dependencies for one operator, only one arm produced Rune-local measurement, and the composition law is **unsatisfiable at Rune's data rates as originally stated**. Phase-1 is therefore a narrow core with local measurement. **PHASE-1 CORE (8 deps):** sklearn (HGB + elastic-net) · MAPIE/crepes (conformal) · OR-Tools (CP-SAT) · HiGHS (MILP) · zstd · PM4Py+Woflan · Hypothesis+mutmut · uid-separated Ed25519 signer. **PRODUCED the two artefacts the red team found MISSING:** the **Mechanism Registry schema** (contracts, determinism, costs *including operator-minutes*, sample needs, OOD behaviour, abstention + guarantee + assumptions, failure modes, applicability envelope, verification, rollback, dependencies, qualification status, **escalation counter**, evidence class) and the **Mechanism Forge design** (contract → verified-outcome dataset with grader ≠ generator → candidates → held-out/OOD/adversarial/resource eval → Pareto → shadow → QUALIFY → monitor; legitimate exit = keep richer cognition, logged so the substitution goal stays falsifiable). ## Key verdicts HGB default + elastic-net fallback (XGBoost **de-privileged** on evidence, reverse-incumbent risk named and attacked) · batch-retrain beats continuous adaptation (linear-only online; Nature 2024 plasticity loss) · **exactly two genuine bandit problems** (routing, retrieval) + DR-OPE harness — deadlocked without ε-randomised logging · expert-structured BNs gated EXPERIMENT (structure learning REJECT) · conformal stack recalibrate→split→adaptive→OOD gate **plus a guarantee state machine (monitor + un-void + abstain ceiling)** — otherwise the attractor is permanent abstention · solver shelf CP-SAT/HiGHS/Z3 with extract-solve-verify and an **independent checker** (VPU 2609.11085: verdict-only checking cannot detect bad encodings ⇒ operator-owned specs ≤50 lines) · FF-Replan for nondeterminism · OR formulations exact-affordable (LP/knapsack/assignment/MILP/RCPSP) · graph engine REJECT before S3 · Count-Min (overestimation = conservative for escalate-rules) + HyperLogLog + reservoir adopted, Bloom-family measurement-gated · **compilation ladder L1–L6 evidenced (2–15×) / L7 partial-evaluation-of-reasoning UNEVIDENCED** · e-graphs REJECT-now/FUTURE-triggered · the verifier (not the generator) buys synthesis reliability · **atomic decision boundary** (OPA/Cedar provably non-atomic under concurrency) · minimal control set = 5 mechanisms with **no plant model** (PID/MPC/model-based-FDD REJECT) · detector ensemble preserves precision + explicit interpretation split. **Measured locally (arm 7):** partial indexes 33× smaller on rare predicates · expression indexes ~170× on JSON tag filtering · FTS5 external-content 4.76× smaller · JSONB 1.29× · zstd+110 KB trained dictionary lifts small-record compression 3.38×→5.08× · **WITHOUT ROWID is a LOSS (+24%)** for hash-PK ledgers. **Crypto:** hash everything integrity-relevant; **sign only the audit head** with a uid-separated Ed25519 key (protects against a *compromised Rune process*, not the operator — exactly the #402 adversary); Merkle-DAG memory, transparency-log architecture and verifiable computation all REJECT (250× prover overhead; flip condition = asymmetric information, not distance). **Never-covered families found (arm Z):** agentic process mining (top pick — sequence BEFORE hand-authored automata), decision-theoretic control of computation/EVOI, compensated & streaming numerics, robust statistics, real-time scheduling, RDMDU, discrete-event simulation, abstract interpretation. **Row truth:** sources 213/147 gate-unique (194 builder) /14 dup groups · applicability 66 · qualification 24 · adversarial 51 · claims 12 · innovation 8 · r0 8 (7 CONFIRMED/1 REFINED) · SEARCH_SATURATION=REACHED · LOAD_BEARING_DEPTH=PASS · 0 mis-pairings shipped (17 caught in-arm; atlas cumulative 42). **Flags:** `LOCAL_MODEL_COMPUTE_EXECUTED = NO` · `LOCAL_MEASUREMENT_EXECUTED = YES (read-only)` · `RUNE_GROWTH_DELTA_DEFINITION = v1.1` preserved · `CANONICAL_MEMORY_WRITE = 0` · `DERIVED_MEMORY_WRITE = 0` · `AH-` gate-scope extension pre-freeze (twelve-domain regression all consistent) · sealed #396–#406, #413, #414 untouched. **RESEARCH CLOSURE: NOT YET CLOSED** — one bounded synthesis pass, not a new tranche; requires **E-H1** (batch-0 measurement of the existing deterministic layer) and **E-H5** (SQLite mechanism A/B) to be *executed*. No further literature research required. **STOP.** Control returned for supervisory review.
Author
Owner

#415 AH — CLOSURE MEASUREMENT PASS COMPLETE — verdict AH_CLOSED

Seal 8ef5486 + closure commit a5da6e0 (both mirrors). Reports: 08_closure_eh1_batch0.md · 08_closure_eh5_sqlite_ab.md · 08_closure_synthesis.md.

E-H1 (batch-0): 75,297 labelled tool calls mined from real stores (1.8 GB opencode.db + 1.47 GB mimocode.db). Deterministic coverage: 5 classes FUNCTIONALLY ADEQUATE, 4 PARTIAL, 4 BROKEN/UNREACHABLE (retry policy, lifecycle validation, use_history counting, model routing), 2 NONE, 1 RICHER-COGNITION-REQUIRED. Unnecessary model share ≈ 5–8%, concentrated in highest-frequency failure classes: 43% of edit errors are stale-context preconditions, 86% of webfetch errors are deterministic HTTP status classes — adoption evidence from actual pain. Revision of #406: a tool-call outcome channel DOES exist (no task-level outcome, but 75k labelled calls).

E-H5 (SQLite A/B on real workload): decisive adopt — expression index takes the real nightly JSON query from 859.6 ms → 0.016 ms (~54,000×) at +0.4% storage; event(type) index 1.6 ms → 0.006 ms. Partial indexes: −93/−99% on 3 queries at S1–S2 but net-negative at current scale (+23% worst query, +75% write cost) → scale-gated CONDITIONAL. WITHOUT ROWID confirmed net-negative (+12% size, +68% range, +23% insert). FTS5 external-content already in production — no gain available. zstd3 on real records 5.97× at 4.6 ms (19× faster than zlib6); trained dictionary INSUFFICIENT_DATA.

Phase-1 requalified by measurement: 8 → 1 EARNED (Hypothesis+mutmut) + 5 CONDITIONAL (sklearn HGB, conformal, zstd, PM4Py, Ed25519 signer) + 1 PARK (CP-SAT) + 1 REJECT (HiGHS) — the solver shelf reversed out: no recurring solver-shaped problem exists in observed Rune work. Operator burden cut ~⅓.

Adversarial pass: 20 attacks, 4 successful (solver translation cost; Phase-1 size; wrongly-assumed-bounded classes; duplication) — all applied.

VERDICT: AH_CLOSED. No implementation started; E-G1/E-G2/E-G3 not touched. HARD STOP honoured — returning control for supervisory review.

# #415 AH — CLOSURE MEASUREMENT PASS COMPLETE — verdict `AH_CLOSED` Seal `8ef5486` + closure commit `a5da6e0` (both mirrors). Reports: `08_closure_eh1_batch0.md` · `08_closure_eh5_sqlite_ab.md` · `08_closure_synthesis.md`. **E-H1 (batch-0):** 75,297 labelled tool calls mined from real stores (1.8 GB opencode.db + 1.47 GB mimocode.db). Deterministic coverage: 5 classes FUNCTIONALLY ADEQUATE, 4 PARTIAL, 4 BROKEN/UNREACHABLE (retry policy, lifecycle validation, `use_history` counting, model routing), 2 NONE, 1 RICHER-COGNITION-REQUIRED. Unnecessary model share ≈ 5–8%, concentrated in highest-frequency failure classes: **43% of edit errors are stale-context preconditions, 86% of webfetch errors are deterministic HTTP status classes** — adoption evidence from actual pain. **Revision of #406:** a tool-call outcome channel DOES exist (no task-level outcome, but 75k labelled calls). **E-H5 (SQLite A/B on real workload):** decisive adopt — expression index takes the real nightly JSON query from **859.6 ms → 0.016 ms (~54,000×)** at +0.4% storage; `event(type)` index 1.6 ms → 0.006 ms. Partial indexes: −93/−99% on 3 queries at S1–S2 but **net-negative at current scale (+23% worst query, +75% write cost) → scale-gated CONDITIONAL**. WITHOUT ROWID confirmed net-negative (+12% size, +68% range, +23% insert). FTS5 external-content **already in production** — no gain available. zstd3 on real records 5.97× at 4.6 ms (19× faster than zlib6); trained dictionary INSUFFICIENT_DATA. **Phase-1 requalified by measurement: 8 → 1 EARNED (Hypothesis+mutmut) + 5 CONDITIONAL** (sklearn HGB, conformal, zstd, PM4Py, Ed25519 signer) **+ 1 PARK (CP-SAT) + 1 REJECT (HiGHS)** — the solver shelf reversed out: no recurring solver-shaped problem exists in observed Rune work. Operator burden cut ~⅓. **Adversarial pass:** 20 attacks, 4 successful (solver translation cost; Phase-1 size; wrongly-assumed-bounded classes; duplication) — all applied. **VERDICT: `AH_CLOSED`.** No implementation started; E-G1/E-G2/E-G3 not touched. HARD STOP honoured — returning control for supervisory review.
gitea-actions Bot added the ready label 2026-10-01 19:44:02 +01:00

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (closed: #2371); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (closed: #2371); Rune may start.
Author
Owner

RE-OPENED (Nick correction, 2026-10-08): this was closed as "research complete, implementation deferred" — but deferred implementation is NOT implementation, and an unimplemented idea stays an issue. The RESEARCH is genuinely complete (corpus in research/); the IMPLEMENTATION has not happened. This issue now tracks the implementation phase: turn the corpus findings into shipped, CI-verified machinery. Open until the ideas are in the codebase.

**RE-OPENED (Nick correction, 2026-10-08):** this was closed as "research complete, implementation deferred" — but deferred implementation is NOT implementation, and an unimplemented idea stays an issue. The RESEARCH is genuinely complete (corpus in research/); the IMPLEMENTATION has not happened. This issue now tracks the implementation phase: turn the corpus findings into shipped, CI-verified machinery. Open until the ideas are in the codebase.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (closed: #2556); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (closed: #2556); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.

🎓 NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH) — dependencies satisfied (scheduled sweep); Rune may start.

🎓 **NEXT: #415 — Algorithmic & Verifiable Mechanisms Atlas — Non-LLM Computational Mechanism Supply (#415 / AH)** — dependencies satisfied (scheduled sweep); Rune may start.
Sign in to join this conversation.
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: conductor/rune#415