Repository navigation
docs(agents): adopt gen_ai.decide for decision spans - #19938
Conversation
Follows sentry-conventions#696, which deprecates gen_ai.evaluate in favor of gen_ai.decide. Renames "evaluation spans" to "decision spans" in the manual instrumentation and product docs, and updates the span op, name, and gen_ai.operation.name values in all code snippets. Keeps the old evaluate names documented as deprecated but still recognized. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
1 Skipped Deployment
|
|
The plan checks page loads, not-found counts, and client errors on the rewritten pages. An issue escalates when those pages stop loading or those errors appear. Telemetry cannot show the new wording. Monitoring in Services: Mention PlanWhat changedPublished pages now describe decision spans. Code samples now use gen_ai.decide for the span op, name, and operation name. The old gen_ai.evaluate names stay documented as deprecated. sentry-docs must deploy before this change is live. The files sit under docs/ and includes/. develop-docs does not ship this content. RiskReaders can copy deprecated span names if the new samples fail to render. A broken include or heading can 404 those agent pages or skip the decision section. Old links to #evaluation-span no longer jump to the heading. This blast stays on the agent documentation pages. Intended effectThis change rewrites documentation copy and code samples. No metric records the new span names on the published pages. The executor cannot set intended_effect from telemetry. Mark intended_effect unknown. If the executor opens the live pages, confirmed means the Decision Span heading and gen_ai.decide samples are present. Absent means those pages still show Evaluation Span and gen_ai.evaluate as the current names. Regression watchWatch the changed agent pages for missing loads, new 404s, and client errors. A drop to zero loads on the conversations page while the agents index still loads is a page break. A rise in product/agents not-found counts is a 404. New errors on those URLs are a client crash.
Site-wide docs errors were 209 in the same window. Those events are mostly search and widget fetch noise on the catch-all Not observableLive page wording after deploy. No metric stores the heading or sample text. In-page jumps to the old Client errors that only tag the catch-all Get Slack DMs about this change: cursor.com/automations/rollouts |
Remove the notes describing the deprecated gen_ai.evaluate op and "evaluate" operation name from the decision span docs. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
Issue detected in Python and Node tracing guides still tell readers to use Evaluation Span This change was supposed to publish Decision Span headings and gen_ai.decide samples on the agent docs. One hour after the ship, the conversations page shows Decision Spans, but the live Python and Node manual pages still load and still present Evaluation Span and gen_ai.evaluate as the current names. Readers of those guides can still copy the old span names. |
|
Verified in
|
## DESCRIBE YOUR PR Follows [sentry-javascript 11.7.0](https://github.com/getsentry/sentry-javascript/releases/tag/11.7.0) ([#25270](getsentry/sentry-javascript#25270), [#25272](getsentry/sentry-javascript#25272), [#25274](getsentry/sentry-javascript#25274), [#25281](getsentry/sentry-javascript#25281)). In that release, Vercel AI, TypeSafe, LangChain/LangGraph, Workers AI, and Mastra classifier spans changed from `gen_ai.evaluate` / `evaluate <model>` to `gen_ai.decide` / `decide <model>`. - Vercel AI: documents `experimental_decide()` (Sentry SDK `11.7.0`+, AI SDK `7.0.128`+) instead of `experimental_evaluate()`. The "Trace Jev Evaluations" section is now "Trace Jev Decisions" (anchor `#trace-jev-decisions`), and it links to the AI SDK's new [Decisions](https://ai-sdk.dev/docs/ai-sdk-core/decisions) page. - TypeSafe, LangChain, LangGraph, Workers AI, and Mastra (the classifier page and the span-type table) now give the span op and name as `gen_ai.decide` and `decide <model>`. - To keep things simple, every decide-span section uses `11.7.0` as its minimum SDK version (`AvailableSince`, requirement lines, and Mastra's supported versions), and the pages don't describe older SDK behavior. - Links that pointed to the old Vercel AI anchor or to `experimental_evaluate()` are updated. #19938 already updated the manual instrumentation and shared span-attribute docs. The LangChain/Mastra "Classifier Evaluations" headings stay as they are, because those are the frameworks' own terms. ## IS YOUR CHANGE URGENT? - [ ] Urgent deadline (GA date, etc.): YYYY-MM-DD - [ ] Other deadline: YYYY-MM-DD - [x] No deadline: Not urgent, can wait up to 1 week+ ## PRE-MERGE CHECKLIST - [ ] Checked Vercel preview for correctness, including links - [ ] PR was reviewed and approved by any necessary SMEs (subject matter experts) - [ ] PR was reviewed and approved by a member of the [Sentry docs team](https://github.com/orgs/getsentry/teams/docs) <!-- junior-request-attribution:start --> via **Andrei Borza**. <!-- junior-request-attribution:end --> <!-- junior-session-footer:start --> <!-- junior-conversation-id:slack%3AC0BKK9QLCUA%3A1791990645.267039 --> -- [View Junior Session](https://junior-prod.sentry.dev/conversations/slack%3AC0BKK9QLCUA%3A1791990645.267039) [[Sentry]](https://sentry.sentry.io/explore/conversations/slack%3AC0BKK9QLCUA%3A1791990645.267039/?project=4510944073809921) <!-- junior-session-footer:end --> --------- Co-authored-by: sentry-junior[bot] <264270552+sentry-junior[bot]@users.noreply.github.com> Co-authored-by: Andrei Borza <andrei.borza@sentry.io>
DESCRIBE YOUR PR
Follows sentry-conventions#696, which deprecates
gen_ai.evaluatein favor ofgen_ai.decide. Renames "evaluation spans" to "decision spans" and updates the span operation, name, andgen_ai.operation.namevalues in all code snippets. The oldevaluatenames stay documented as deprecated but still recognized, since the product continues to support them.gen_ai.decideop,decide {model}name,gen_ai.operation.name: "decide"decidevalues plus a deprecation note (innertype: "evaluation"JSON field unchanged, matching the convention)predicateadded to answer types, anchors updated to#decision-span(s)#decision-spansdecisionskeywordgen_ai.decideversionsPart of TET-3102
IS YOUR CHANGE URGENT?
Help us prioritize incoming PRs by letting us know when the change needs to go live.
Select exactly one option. For deadlines, replace
YYYY-MM-DDwith the due date. You can update this information later by editing the PR description.SLA
Thanks in advance for your help!
PRE-MERGE CHECKLIST
Make sure you've checked the following before merging your changes:
🤖 Generated with Claude Code