Skip to content

docs(javascript): Rename gen_ai.evaluate spans to gen_ai.decide - #19971

Merged
andreiborza merged 2 commits into
masterfrom
abrz/js-gen-ai-decide
Oct 14, 2026
Merged

andreiborza merged 2 commits into
masterfrom
abrz/js-gen-ai-decide

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

DESCRIBE YOUR PR

Follows sentry-javascript 11.7.0 (#25270, #25272, #25274, #25281). In that release, Vercel AI, TypeSafe, LangChain/LangGraph, Workers AI, and Mastra classifier spans changed from gen_ai.evaluate / evaluate <model> to gen_ai.decide / decide <model>.

  • Vercel AI: documents experimental_decide() (Sentry SDK 11.7.0+, AI SDK 7.0.128+) instead of experimental_evaluate(). The "Trace Jev Evaluations" section is now "Trace Jev Decisions" (anchor #trace-jev-decisions), and it links to the AI SDK's new Decisions page.
  • TypeSafe, LangChain, LangGraph, Workers AI, and Mastra (the classifier page and the span-type table) now give the span op and name as gen_ai.decide and decide <model>.
  • To keep things simple, every decide-span section uses 11.7.0 as its minimum SDK version (AvailableSince, requirement lines, and Mastra's supported versions), and the pages don't describe older SDK behavior.
  • Links that pointed to the old Vercel AI anchor or to experimental_evaluate() are updated.

#19938 already updated the manual instrumentation and shared span-attribute docs. The LangChain/Mastra "Classifier Evaluations" headings stay as they are, because those are the frameworks' own terms.

IS YOUR CHANGE URGENT?

  • Urgent deadline (GA date, etc.): YYYY-MM-DD
  • Other deadline: YYYY-MM-DD
  • No deadline: Not urgent, can wait up to 1 week+

PRE-MERGE CHECKLIST

  • Checked Vercel preview for correctness, including links
  • PR was reviewed and approved by any necessary SMEs (subject matter experts)
  • PR was reviewed and approved by a member of the Sentry docs team

via Andrei Borza.

--

View Junior Session [Sentry]

Co-Authored-By: Andrei Borza <andrei.borza@sentry.io>
@vercel

vercel Bot commented Oct 14, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sentry-docs Ready Ready Preview Oct 14, 2026 3:40pm UTC
1 Skipped Deployment
Project Deployment Actions Updated
develop-docs Ignored Ignored Preview Oct 14, 2026 3:40pm UTC

Request Review

@github-actions github-actions Bot added the Priority: Normal Docs review has no urgent deadline label Oct 14, 2026
@cursor

cursor Bot commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

The change rewrites JavaScript agent-tracing docs to the new span names and marks them available since 11.7.0. The plan checks client errors on those docs, HTTP 5xx, HTTP 404, and load volume on the renamed pages. An issue escalates when those pages fail to load or new client errors appear.

Rollout complete

Services: sentry-docs.

Plan

What changed

JavaScript docs now describe gen_ai.decide spans and experimental_decide, and they mark those features as available since 11.7.0. sentry-docs must deploy before this wording is live.

Risk

A bad MDX render can 404 these pages on the shared docs route. That outage can also hide sibling JavaScript docs. The pages no longer warn that older SDKs still emit gen_ai.evaluate. The heading identifier for Jev tracing changed. Old fragment links miss the section but still load the page.

Intended effect

This is a docs wording change. Sentry does not record that the live pages now say gen_ai.decide or available since 11.7.0. Page load volume only shows that the route still exists. It does not show the new text. Record intended effect as unknown from telemetry. Absent would be the live pages still saying gen_ai.evaluate or an older since version. That check is not in Sentry.

Regression watch

Client traces sample at 30 percent. Error events are not sampled the same way. Do not divide error counts by sampled page loads. Compare each signal to its own 24h band. Session now is 2026-10-14T15:19:51Z. Last 24h is 2026-10-13T15:19:51Z to 2026-10-14T15:19:51Z. Prior 24h is 2026-10-12T15:19:51Z to 2026-10-13T15:19:51Z. Source for every row is Sentry org sentry, project docs.

Signal Baseline Rule Source
Production client errors on JavaScript docs 32 events in last 24h. 68 events in last 48h, so 36 in prior 24h. Band 32-36 events per 24h Hold in 32-36 events per 24h. Escalate if the count rises above the band while site page loads hold environment:production url:*platforms/javascript/* on dataset errors, field count()
Production client errors site-wide 143 events in last 24h. 323 events in last 48h, so 180 in prior 24h. Band 143-180 events per 24h Hold in 143-180 events per 24h. Escalate if the count rises above the band environment:production on dataset errors, field count()
Client errors on the renamed page URLs 0 events in last 24h and last 48h Hold at 0 environment:production http.url:[*langchain*, *langgraph*, *typesafe*, *vercelai*, *workers-ai*, *classifier-evaluations*, *manual-instrumentation*] on dataset errors, field count()
HTTP 5xx spans 0 spans in last 24h and last 48h Hold at 0 http.response_status_code:>=500 environment:production on dataset spans, field count()
HTTP 404 spans 130 spans in last 24h. 223 spans in last 48h, so 93 in prior 24h. Band 93-130 spans per 24h Hold in 93-130 spans per 24h. Escalate if 404s rise above the band while site page loads hold environment:production http.response_status_code:404 on dataset spans, field count()
Sampled pageload and navigation volume on the renamed pages Sum of seven url.full queries: 46 spans in last 24h, 93 in last 48h, so 47 in prior 24h. Site pageload and navigation volume was 18763 then 18444. Share 0.24-0.26% Hold the share in 0.24-0.26%. Escalate if the share falls below the band while site page loads hold. Counts are low, so treat a drop to zero as the clear fail For each slug run span.op:[pageload,navigation] environment:production url.full:*<slug>* with slugs langchain, langgraph, typesafe, vercelai, workers-ai, classifier-evaluations, and agent-tracing/manual-instrumentation. Sum count(). Site volume uses environment:production span.op:[pageload,navigation]

If JavaScript docs errors rise, check whether the renamed pages still render. Then check sibling JavaScript integration pages on the same route.

Not observable

Live HTML that contains gen_ai.decide, experimental_decide, or available since 11.7.0 is not in Sentry. Hits to the old heading trace-jev-evaluations are not in Sentry. The Mastra classifier-evaluations page had 0 sampled loads in 48h, so volume cannot watch that page. The Mastra include what-gets-captured has no URL of its own.

Co-Authored-By: Andrei Borza <andrei.borza@sentry.io>
@andreiborza
andreiborza merged commit 8ce0d5b into master Oct 14, 2026
27 checks passed
@andreiborza
andreiborza deleted the abrz/js-gen-ai-decide branch October 14, 2026 15:48

This branch was successfully deployed

1 active deployment
Preview – sentry-docs — 890ba170 Deployed Oct 14, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Priority: Normal Docs review has no urgent deadline

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants