feat(memory): preserve Agent tool history with bounded context by icecrasher321 · Pull Request #8003 · simstudioai/sim

icecrasher321 · 2026-09-19T02:33:36Z

Summary

Agents preserve assistant tool-call batches, original arguments, terminal results, and final responses in ordered conversation history. Existing retries and model fallbacks continue from recorded outcomes without repeating completed tools. Uncertain outcomes remain at-least-once.
Keep conversation storage, invocation checkpoints, and provider adaptation separate. The existing large-value service stores encrypted payloads; compact checkpoints reference each immutable step/result instead of repeatedly rewriting accumulated payloads.
Budget complete history groups before every provider generation against the actual model, reserving instructions, tools, attachments, and output. Default recalled history targets 16,000 estimated tokens. Estimates trim optional history without rejecting required prompts or tool results; the provider enforces its actual context limit. Large results use bounded previews; authorized agent_memory_read retrieves omitted details. Bounded, metered summaries preserve useful older context without replacing original records.
Preserve legacy conversations and plain-message Memory API, Memory block, and Pi contracts. Update Agent docs and add an additive migration, version-aware writers, capture controls, and rollback guidance. Drain old workers before enabling new storage/checkpoint writes.

Type of Change

New feature
Documentation

Testing

3,138 memory, Agent, and provider regression tests passed; 60 gated tests skipped. Five protocol families have adapter/streaming fixtures.
55 isolated PostgreSQL tests passed, including migration, concurrent appends/CAS, immutable legacy prefixes, provenance, deletion/recreation, bounded reads, artifact ownership, and encrypted summary-cache projection. These suites are included in PostgreSQL CI.
Lint, all 47 repository audits, all 26 workspace type checks, generated-doc checks, migration safety, and Drizzle metadata validation passed.
Ran bun run dev:full and synthetic workflows through V2 APIs. OpenAI Responses, Chat Completions, Anthropic, and Gemini verified persisted tool-result recall. Anthropic/Gemini streamed tool turns and subsequent recall passed; Chat Completions streaming recall was verified separately from its existing settled tool loop.
Injected failures after a completed tool result: Responses, Anthropic, and Gemini fallbacks each received the result with one tool execution. A streamed fallback and subsequent recall also completed with one tool execution. Large-result retrieval recovered a tail detail from a 140 KB result without rerunning the tool. A six-stage live tool loop summarized active history, preserved receipts, and included summary usage exactly once.
Live context-pressure tests passed for Chat Completions, Anthropic, and Gemini; summaries remained encrypted and absent from public memory responses. Bedrock has fixture coverage only. Live tests used synthetic data and an isolated local database.

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

vercel · 2026-09-19T02:33:43Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated
docs	Skipped		Sep 19, 2026 10:43pm UTC

…t-memory

greptile-apps · 2026-09-19T19:01:37Z

Confidence Score: 5/5

The PR appears safe to merge; the previous findings are resolved and no actionable new regression was established in the changes since the prior review.

Summary

This PR adds durable, bounded Agent conversation history that records completed tool exchanges and reuses their outcomes across retries and model fallbacks.

Introduces immutable conversation steps, checkpoints, encrypted summaries, bounded large-result previews, and authorized detail retrieval.
Adds context budgeting and provider-specific history adaptation across the supported protocol families.
Preserves legacy plain-message memory projections while extending internal rich history.
Adds database storage, migration metadata, extensive provider and persistence tests, documentation, feature controls, and rollback guidance.

Diagram

sequenceDiagram
  participant Agent as Agent Handler
  participant Memory as Durable Memory
  participant Model as Provider Model
  participant Tool as Tool Runtime

  Agent->>Memory: Open invocation turn and load bounded history
  Memory-->>Agent: Complete prior message/tool groups
  Agent->>Model: Generate with selected history
  Model-->>Agent: Assistant tool-call batch
  Agent->>Memory: Checkpoint assistant calls
  Agent->>Tool: Execute unresolved calls
  Tool-->>Agent: Results or terminal errors
  Agent->>Memory: Persist immutable completed exchange
  Agent->>Model: Continue with recorded results
  alt provider failure
    Agent->>Model: Retry or fallback with same recorded outcomes
  end
  Model-->>Agent: Final response
  Agent->>Memory: Finalize turn

_{Reviews (6) · Last reviewed commit: "fix(memory): admit only complete stored ..."}

cubic-dev-ai

All reported issues were addressed

_{Tip: instead of fixing issues one by one fix them all with cubic

Re-trigger cubic}

…t-memory

icecrasher321 · 2026-09-19T21:18:03Z

@greptile

icecrasher321 · 2026-09-19T21:18:04Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-19T21:18:09Z

@cubic-dev-ai review this PR

@icecrasher321 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 177 files

_{Tip: instead of fixing issues one by one fix them all with cubic

Re-trigger cubic}

icecrasher321 · 2026-09-19T21:47:13Z

@greptile

icecrasher321 · 2026-09-19T21:47:14Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-19T21:47:21Z

@cubic-dev-ai review this PR

@icecrasher321 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 178 files

_{Reply with feedback, questions, or to request a fix.

Fix all with cubic | Re-trigger cubic}

icecrasher321 · 2026-09-19T22:12:51Z

@greptile

icecrasher321 · 2026-09-19T22:12:51Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-19T22:12:59Z

@cubic-dev-ai review this PR

@icecrasher321 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 178 files

_{Reply with feedback, questions, or to request a fix.

Fix all with cubic | Re-trigger cubic}

icecrasher321 · 2026-09-19T22:26:28Z

@greptile

icecrasher321 · 2026-09-19T22:26:29Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-19T22:26:36Z

@cubic-dev-ai review this PR

@icecrasher321 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 178 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Re-trigger cubic}

icecrasher321 · 2026-09-19T22:43:57Z

@greptile

icecrasher321 · 2026-09-19T22:43:58Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-19T22:44:03Z

@cubic-dev-ai review this PR

@icecrasher321 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 180 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Re-trigger cubic}

feat(memory): preserve durable Agent tool history

a35345e

icecrasher321 force-pushed the codex/durable-agent-memory branch from b00d15e to a35345e Compare September 19, 2026 02:34

vercel Bot deployed to Preview September 19, 2026 02:36 View deployment

docs(agent): explain durable tool history and context limits

94da520

vercel Bot deployed to Preview September 19, 2026 17:42 View deployment

icecrasher321 added 6 commits September 19, 2026 11:25

feat(memory): bound durable context and retrieve retained tool detail

53160eb

Merge staging and regenerate durable memory migration

18557c1

fix(memory): validate checkpoint recovery and bounded summary coverage

40cf7d5

Merge remote-tracking branch 'origin/staging' into codex/durable-agen…

3174e38

…t-memory

chore(db): format durable memory migration metadata

dcebd6b

Merge remote-tracking branch 'origin/staging' into codex/durable-agen…

8880eca

…t-memory

icecrasher321 changed the title ~~feat(memory): preserve durable Agent tool history~~ feat(memory): preserve Agent tool history with bounded context Sep 19, 2026

icecrasher321 marked this pull request as ready for review September 19, 2026 18:57

Merge remote-tracking branch 'origin/staging' into codex/durable-agen…

8b21ea4

…t-memory

vercel Bot deployed to Preview September 19, 2026 18:58 View deployment

vercel Bot deployed to Preview September 19, 2026 19:01 View deployment

greptile-apps Bot reviewed Sep 19, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/agent/agent-handler.ts Outdated

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

docs(memory): remove redundant internal README

c738da8

vercel Bot temporarily deployed to Preview September 19, 2026 19:09 Inactive

icecrasher321 added 2 commits September 19, 2026 14:13

Merge remote-tracking branch 'origin/staging' into codex/durable-agen…

2a6faa6

…t-memory

fix(memory): preserve tool loops and harden durable history

bfc2c4e

vercel Bot deployed to Preview September 19, 2026 21:18 View deployment

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

fix(memory): preserve stream usage and bound portable history

38d7552

vercel Bot temporarily deployed to Preview September 19, 2026 21:46 Inactive

greptile-apps Bot reviewed Sep 19, 2026

View reviewed changes

Comment thread apps/sim/providers/openrouter/index.ts

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/agent/memory.ts

Comment thread apps/sim/providers/bedrock/request-history.ts Outdated

Comment thread apps/sim/lib/memory/conversation-store.ts Outdated

fix(memory): surface bounded history and validate replay inputs

40a8923

vercel Bot temporarily deployed to Preview September 19, 2026 22:11 Inactive

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/agent/memory.ts

Comment thread apps/sim/executor/handlers/agent/memory.ts Outdated

fix(memory): retain legacy function call exchanges

f912fde

vercel Bot temporarily deployed to Preview September 19, 2026 22:25 Inactive

greptile-apps Bot reviewed Sep 19, 2026

View reviewed changes

Comment thread apps/sim/executor/handlers/agent/memory.ts Outdated

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

fix(memory): admit only complete stored tool exchanges

7ccce6a

vercel Bot temporarily deployed to Preview September 19, 2026 22:43 Inactive

cubic-dev-ai Bot reviewed Sep 19, 2026

View reviewed changes

icecrasher321 merged commit 4e72b2b into staging Sep 20, 2026
35 checks passed

icecrasher321 deleted the codex/durable-agent-memory branch September 20, 2026 00:25

waleedlatif1 mentioned this pull request Sep 21, 2026

v0.8.48: prewarm, tin pg extensions, knowledge search speedups, ui consolidation, keyword search speedups #8096

Merged

Conversation

icecrasher321 commented Sep 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Sep 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

greptile-apps Bot commented Sep 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 19, 2026

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

icecrasher321 commented Sep 19, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 19, 2026

icecrasher321 commented Sep 19, 2026 •

edited

Loading

vercel Bot commented Sep 19, 2026 •

edited

Loading

greptile-apps Bot commented Sep 19, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading