Issues

• The two arms are not the same experiment: codex runs with danger-full-access and read the operator's skills

  UnityInFlow/agent-observatory#65 · Filter by author hermanngeorge15 opened on Aug 31, 2026
  2

• Hooks fire on every codex run, isolated or not — and the operator's hooks.json is only broken by luck

  bug
  UnityInFlow/agent-observatory#64 · Filter by author hermanngeorge15 opened on Aug 28, 2026
  1

• Nothing validates a run record: three descriptions, none of them executes

  UnityInFlow/agent-observatory#53 · Filter by author hermanngeorge15 opened on Aug 25, 2026 · Foundation — the instrument

• [P1] Isolation flags do not cover hooks — 21 registered, ~25 executions per run, and the count tracks the arm

  bug
  UnityInFlow/agent-observatory#49 · Filter by author hermanngeorge15 opened on Aug 10, 2026
  4

• [P0] Permission-mode block recorded as incorrect code (harness bug #7)

  bug
  UnityInFlow/agent-observatory#47 · Filter by author hermanngeorge15 opened on Aug 9, 2026
  2

• [P2] Close UI, CI, and documentation verification gaps

  documentationenhancement
  UnityInFlow/agent-observatory#43 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P2] Strengthen API data integrity, pagination, and query efficiency

  enhancement
  UnityInFlow/agent-observatory#42 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P1] Enforce OTel privacy and metric cardinality at the collector boundary

  buggovernance
  UnityInFlow/agent-observatory#41 · Filter by author hermanngeorge15 opened on Aug 9, 2026
  1

• [P1] Make Prometheus experiment metrics idempotent and rebuildable

  bug
  UnityInFlow/agent-observatory#40 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P1] Separate run execution, measurement validity, evaluation, and invalidation

  enhancement
  UnityInFlow/agent-observatory#39 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P1] Version benchmark contracts and execute task/evaluator from the recorded revision

  bugenhancement
  UnityInFlow/agent-observatory#38 · Filter by author hermanngeorge15 opened on Aug 9, 2026
  1

• [P1] Add an immutable first-class ExperimentProtocol with server-side locking

  enhancement
  UnityInFlow/agent-observatory#37 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P0] Correct the Claude instruction treatment: AGENTS.md is not loaded natively

  adapterbug
  UnityInFlow/agent-observatory#36 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• [P0] Isolate Claude runs and persist requested plus resolved model identity

  adapterbug
  UnityInFlow/agent-observatory#35 · Filter by author hermanngeorge15 opened on Aug 9, 2026
  2

• [P0] Restart the model-tier experiment as a genuinely preregistered V2

  bug
  UnityInFlow/agent-observatory#34 · Filter by author hermanngeorge15 opened on Aug 9, 2026

• Governance — bank privacy checklist before any team rollout

  governance
  UnityInFlow/agent-observatory#11 · Filter by author hermanngeorge15 opened on Aug 8, 2026
  1

• M11 — Codex adapter: normalize logs, do not fake trace parity

  adapter
  UnityInFlow/agent-observatory#10 · Filter by author hermanngeorge15 opened on Aug 8, 2026
  1