Repository navigation
chore: Deprecate gen_ai.evaluate in favor of new gen_ai.decide - #696
Merged
Merged
Conversation
alexander-alderman-webb
requested review from
a team,
Lms24,
cleptric,
mjq and
nsdeschenes
as code owners
October 12, 2026 07:50
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Semver Impact of This PR🟢 Patch (bug fixes) 📋 Changelog PreviewThis is how your changes will appear in the changelog. New Features ✨Attributes
Other
Bug Fixes 🐛Attributes
Other
Documentation 📚
Internal Changes 🔧Deps
Other
🤖 This preview updates automatically when you update the PR. |
obostjancic
approved these changes
Oct 12, 2026
andreiborza
approved these changes
Oct 12, 2026
This was referenced Oct 12, 2026
Closed
Closed
Rename Vercel AI
experimental_decide spans from evaluate to decide
getsentry/sentry-javascript#25251
Closed
Lms24
approved these changes
Oct 12, 2026
4 tasks done
andreiborza
added a commit
to getsentry/sentry-javascript
that referenced
this pull request
Oct 12, 2026
…cide spans (#25272) ## What Workers AI calls to TypeSafe Jev and Cloudflare Clef models now create `decide <model>` spans with op `gen_ai.decide`, instead of `gen_ai.evaluate`. ## Why `gen_ai.evaluate` is deprecated in favor of `gen_ai.decide` (getsentry/sentry-conventions#696), to match the Vercel AI rename to `experimental_decide`. Closes: #25250 --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
andreiborza
added a commit
to getsentry/sentry-javascript
that referenced
this pull request
Oct 12, 2026
….decide spans (#25270) ## What Jev calls from the TypeSafe and LangChain integrations now create `decide <model>` spans with op `gen_ai.decide`, instead of `gen_ai.evaluate`. ## Why `gen_ai.evaluate` is deprecated in favor of `gen_ai.decide` (getsentry/sentry-conventions#696), to match the Vercel AI rename to `experimental_decide`. Closes: #25249 --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
andreiborza
added a commit
to getsentry/sentry-javascript
that referenced
this pull request
Oct 12, 2026
…_ai.decide spans (#25274) ## What Vercel AI `experimental_decide` calls now create `decide <model>` spans with op `gen_ai.decide`, instead of `gen_ai.evaluate`. ## Why `gen_ai.evaluate` is deprecated in favor of `gen_ai.decide` (getsentry/sentry-conventions#696), to match the Vercel AI rename to `experimental_decide`. Closes: #25251 --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
andreiborza
added a commit
to getsentry/sentry-javascript
that referenced
this pull request
Oct 12, 2026
…e spans (#25281) ## What Mastra classifier evaluations now create `decide <model>` spans with op `gen_ai.decide`, instead of `gen_ai.evaluate`. ## Why `gen_ai.evaluate` is deprecated in favor of `gen_ai.decide` (getsentry/sentry-conventions#696), to match the Vercel AI rename to `experimental_decide`. Closes: #25252 Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
1 of 6 tasks
ArthurKnaus
added a commit
to getsentry/sentry-docs
that referenced
this pull request
Oct 13, 2026
Follows [sentry-conventions#696](getsentry/sentry-conventions#696), which deprecates `gen_ai.evaluate` in favor of `gen_ai.decide`. Renames "evaluation spans" to "decision spans" and updates the span operation, name, and `gen_ai.operation.name` values in all code snippets. The old `evaluate` names stay documented as deprecated but still recognized, since the product continues to support them. - Manual instrumentation (JS + Python): "Decision Span" section, `gen_ai.decide` op, `decide {model}` name, `gen_ai.operation.name: "decide"` - Shared attributes include: new `decide` values plus a deprecation note (inner `type: "evaluation"` JSON field unchanged, matching the convention) - Conversations product doc: "Decision Spans" section, updated example, `predicate` added to answer types, anchors updated to `#decision-span(s)` - php/laravel cross-link retargeted to `#decision-spans` - Agents index: added `decisions` keyword - Replaced the two span-detail screenshots with `gen_ai.decide` versions Part of TET-3102
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Aligning with Vercel AI, that deprecated their experimental evaluate telemetry in favor of decide telemetry.
PR Checklist
yarn testand verified that the tests pass.yarn generateto generate and format code and docs.If an attribute was added:
nextjs.function_id, notfunction_id)apply_scrubbing(i.e.manualorauto. Useneveronly for values that should never be scrubbed such as IDs)If an attribute was deprecated: