[`opentelemetry-instrumentation-genai-bedrock`] Add inference spans for `Converse` and `ConverseStream` methods by DylanRussell · Pull Request #488 · open-telemetry/opentelemetry-python-genai

DylanRussell · 2026-08-27T15:42:26Z

Description

Adds logic to create an InferenceInvocation and parse the request/response for attributes and set them on the invocation for the Converse and ConverseStream methods in boto3.

Remaining gaps:

Similar logic needs to be added for the InvokeModel & InvokeModelWithResponseStream methods
We need to monkey patch aioboto3 to get the async equivalents.

Type of change

Please delete options that are not relevant.

New feature (non-breaking change which adds functionality)

How has this been tested?

Unit tests..

Checklist

Followed the style guidelines of this project
Changelog updated if the change requires an entry
Unit tests added
Documentation updated

Copilot

Pull request overview

This PR introduces and wires up a new opentelemetry-instrumentation-genai-bedrock package that instruments AWS Bedrock (via boto3/botocore) to emit GenAI inference (“chat”) spans for the Converse and ConverseStream APIs, including basic request/response extraction and streaming support.

Changes:

Added Bedrock runtime instrumentation by patching botocore.client.BaseClient._make_api_call for Converse/ConverseStream and mapping request/response fields onto an InferenceInvocation.
Added a streaming wrapper for converse_stream to keep the invocation open until the stream completes (or fails/closes).
Added package wiring (tox envs, workspace deps, docs requirements) plus unit tests, conformance scenarios, and VCR cassettes/examples.

Reviewed changes

Copilot reviewed 37 out of 37 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
uv.lock	Adds the Bedrock package to the workspace lock and pulls in boto3/botocore deps.
tox.ini	Wires Bedrock test/conformance/lint envs; adjusts shellcheck env.
README.md	Adds Bedrock instrumentation entry to the top-level table.
pyproject.toml	Adds Bedrock package to workspace dependencies and pyright include/exclude.
docs-requirements.txt	Adds `boto3` as a docs build dependency.
instrumentation/opentelemetry-instrumentation-genai-bedrock/README.rst	Documents supported Bedrock operations and configuration.
instrumentation/opentelemetry-instrumentation-genai-bedrock/pyproject.toml	Defines the new package, deps, extras, and instrumentor entrypoint.
instrumentation/opentelemetry-instrumentation-genai-bedrock/LICENSE	Adds Apache 2.0 license file for the new package.
instrumentation/opentelemetry-instrumentation-genai-bedrock/CHANGELOG.md	Adds a towncrier-managed changelog stub.
instrumentation/opentelemetry-instrumentation-genai-bedrock/.changelog/.gitignore	Keeps the changelog dir tracked.
instrumentation/opentelemetry-instrumentation-genai-bedrock/.changelog/359.added	Towncrier fragment for initial package scaffold.
instrumentation/opentelemetry-instrumentation-genai-bedrock/.changelog/488.added	Towncrier fragment for Converse/ConverseStream spans.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/init.py	Implements `BedrockInstrumentor` and completion-hook wiring.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/version.py	Sets package version.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/package.py	Declares `_instruments` dependency metadata.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/patch.py	Patches botocore API calls and creates/stops invocations.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/extractors.py	Extracts Bedrock request/response fields into invocation attributes.
instrumentation/opentelemetry-instrumentation-genai-bedrock/src/opentelemetry/instrumentation/genai/bedrock/stream.py	Implements streaming wrapper to finalize spans on stream end/error/close.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/init.py	Marks test package.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/conftest.py	Adds shared fixtures + VCR config + Bedrock client/instrument fixtures.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/test_instrumentor.py	Tests instrument/uninstrument lifecycle and dependency string.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/test_converse.py	Tests non-streaming Converse spans and request/response extraction.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/test_converse_stream.py	Tests ConverseStream spans, stream lifecycle, and error paths.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/test_completion_hook.py	Tests completion hook invocation and default hook loading behavior.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/test_conformance.py	Runs Bedrock conformance scenarios via weaver live-check.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/conformance/init.py	Marks conformance scenario package.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/conformance/inference.py	Conformance scenario for chat inference (Converse).
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/conformance/inference_streaming.py	Conformance scenario for streaming chat (ConverseStream).
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/conformance/tool_calling.py	Conformance scenario for tool calling in chat.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/requirements.oldest.txt	Oldest factor requirements file (comment-only).
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/requirements.latest.txt	Latest factor requirements incl. boto3 and editable workspace installs.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_with_content.yaml	VCR cassette for Converse with content capture.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_no_content.yaml	VCR cassette for Converse without content capture.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_with_invalid_model.yaml	VCR cassette for Converse invalid-model error.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_with_content_different_events.yaml	VCR cassette for Converse with different event patterns.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_no_content_different_events.yaml	VCR cassette for Converse (no-content) with different event patterns.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_tool_call_with_content.yaml	VCR cassette for tool call flow (with content).
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_tool_call_no_content.yaml	VCR cassette for tool call flow (no content).
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_with_content.yaml	VCR cassette for ConverseStream with content.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_no_content.yaml	VCR cassette for ConverseStream without content.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_with_invalid_model.yaml	VCR cassette for ConverseStream invalid-model error.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_with_content_different_events.yaml	VCR cassette for streaming with different event patterns.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_no_content_different_events.yaml	VCR cassette for streaming (no-content) with different event patterns.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_handles_event_stream_error.yaml	VCR cassette for streaming error handling test.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_close_before_consumption.yaml	VCR cassette for closing stream before iteration.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_caller_side_error.yaml	VCR cassette for caller-side exception inside stream context manager.
instrumentation/opentelemetry-instrumentation-genai-bedrock/tests/cassettes/test_converse_stream_tool_call_parsing_errors.yaml	Adds a cassette intended for tool-call parsing error coverage.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/manual/README.rst	Manual instrumentation example documentation.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/manual/main.py	Manual instrumentation example code.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/manual/custom_hook.py	Example showing a custom completion hook.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/manual/requirements.txt	Requirements for the manual example.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/manual/.env	Content-capture env for manual example.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/zero-code/README.rst	Zero-code example documentation.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/zero-code/main.py	Zero-code example application.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/zero-code/requirements.txt	Requirements for the zero-code example.
instrumentation/opentelemetry-instrumentation-genai-bedrock/examples/zero-code/.env	Content-capture env for zero-code example.

Suppressed comments (1)

tox.ini:374

The shellcheck command uses find ... -print | xargs shellcheck ..., which can break on paths with whitespace and can invoke shellcheck with no arguments depending on xargs behavior. Using find ... -exec ... + avoids these edge cases and is portable across GNU/BSD userlands.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

opentelemetry-pr-dashboard · 2026-08-27T16:05:37Z

Pull request dashboard status

Merged · refreshed 2026-09-01 22:08 UTC

Status above doesn't look right?

Anything look wrong? Report it with what you expected; it helps us improve the dashboard.

- Only extract tool_definitions when capture_content is True - Remove unnecessary try/except TypeError in BedrockConverseStreamWrapper - Restrict bedrock latest envlist to py3{10,14} matching repo convention - Remove unused cassette files and add tests for tool calling with NO_CONTENT - Update opentelemetry-util-genai floor to >= 1.2b0.dev in pyproject.toml

lmolkova · 2026-08-28T05:52:06Z

+            response=tool_result.get("content"),
+        )
+
+    return None


reasoningContent and the other non-text blocks are dropped, should we follow up on the other parts in a separate PR?

I added it in here.. WDYT of the various supported block types here (https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ReasoningContentBlock.html) -- i left out audio / video blocks, but added parsing for document / image types.. not sure what the best approach is

we can add them as GenericPart and create semconv issue to add others.

BTW, would you mind updating Blob (deprecated now) -> BlobPart and such?

Opened open-telemetry/semantic-conventions-genai#488 and used GenericPart for them. Switched to XPart types too..

On second thought I wonder if it's worth adding these as GenericParts with just the type set, is that useful at all ? I don't think we will ever add raw audio / video to the telemetry, it's way too big.

Even a single image can be too big.. Google's telemetry API has a cap at 64KB for an attribute value for example.. Maybe we should be checking the size of BlobParts (like mages) and leaving them out if they exceed 50KB or something like that..

linux-foundation-easycla · 2026-08-31T17:34:37Z

The committers listed above are authorized under a signed CLA.

✅ login: DylanRussell / name: Dylan Russell (0525831, 0e1ed08, 0ea04d0, 13334ce, 1493e95, 265e74b, 30ae1ca, 35fed65, 437fe37, 4e7e194, 5dfac25, 60558ba, 60ddbed, 843803c, 878c484, 8913455, 8d4ee01, 996fa05, 9fda6a7, a46c717, aa91bbc, b078727, c8964e3, c93ba0e, d370132, d3e1769, d873914, e292ca3, e4b3812, e71e5e7, f1c1d4e, fd1f251)
✅ login: DylanRussell / name: DylanRussell (b5b02ac)

DylanRussell · 2026-08-31T18:31:17Z

I recorded all the VCR tests against the real API and got passing results.. updated all the .yaml files with the real req/resp exchange..

- Only extract tool_definitions when capture_content is True - Remove unnecessary try/except TypeError in BedrockConverseStreamWrapper - Restrict bedrock latest envlist to py3{10,14} matching repo convention - Remove unused cassette files and add tests for tool calling with NO_CONTENT - Update opentelemetry-util-genai floor to >= 1.2b0.dev in pyproject.toml

…del as expected violation

…dContent support in content blocks

…rom tox.ini

Copilot AI lite review requested due to automatic review settings August 27, 2026 15:42

DylanRussell requested a review from a team as a code owner August 27, 2026 15:42

github-project-automation Bot added this to GenAI Semantic Conventions and Instrumentation libraries Aug 27, 2026

Copilot started reviewing on behalf of DylanRussell August 27, 2026 15:55 View session

DylanRussell changed the base branch from main to DylanRussell/add_bedrock_instrumentation August 27, 2026 15:57

Copilot AI reviewed Aug 27, 2026

View reviewed changes

opentelemetry-pr-dashboard Bot mentioned this pull request Aug 27, 2026

Pull Request Dashboard #171

Open

lmolkova approved these changes Aug 28, 2026

View reviewed changes

Base automatically changed from DylanRussell/add_bedrock_instrumentation to main August 31, 2026 18:25

DylanRussell force-pushed the DylanRussell/add_bedrock_instrumentation_2 branch from 12324ee to bb9bb86 Compare August 31, 2026 20:23

DylanRussell added 15 commits September 1, 2026 13:57

Add monkey patching for Converse and ConverseStream

84fb4d2

Add conformance testing

80bc851

style: format conformance tests with ruff

682ef4e

Do not guard tool_definitions with capture_content

32bbde6

fix(bedrock): drop response_model_name and declare gen_ai.response.mo…

567a051

…del as expected violation

feat(bedrock): add reasoningContent, document, video, audio, and guar…

d6621da

…dContent support in content blocks

revert(bedrock): drop video and audio content block parsing

511065c

revert(bedrock): drop guardContent block parsing

bafe754

Fix content extraction

1af48a5

style(bedrock): remove redundant lint-instrumentation-genai-bedrock f…

0958c7f

…rom tox.ini

Record conformance tests

dd17819

docs(bedrock): add changelog fragment for PR 488

f3ec20b

refactor(bedrock): switch to XXPart types (BlobPart, TextPart, etc.)

6b1c83e

feat(bedrock): capture unparsed content block variants as GenericPart

0790ca7

DylanRussell force-pushed the DylanRussell/add_bedrock_instrumentation_2 branch from d2f38ba to 0790ca7 Compare September 1, 2026 13:57

fix(bedrock): map tool_use finish reason to tool_call

4e086cc

lmolkova added this pull request to the merge queue Sep 1, 2026

github-merge-queue Bot removed this pull request from the merge queue due to no response for status checks Sep 1, 2026

lmolkova added this pull request to the merge queue Sep 1, 2026

Merged via the queue into main with commit d6d3aca Sep 1, 2026
71 checks passed

lmolkova deleted the DylanRussell/add_bedrock_instrumentation_2 branch September 1, 2026 21:35

github-project-automation Bot moved this to Done in GenAI Semantic Conventions and Instrumentation libraries Sep 1, 2026

Navigation Menu

Uh oh!

[`opentelemetry-instrumentation-genai-bedrock`] Add inference spans for `Converse` and `ConverseStream` methods - #488

[`opentelemetry-instrumentation-genai-bedrock`] Add inference spans for `Converse` and `ConverseStream` methods#488
lmolkova merged 16 commits into
mainfrom
DylanRussell/add_bedrock_instrumentation_2

DylanRussell commented Aug 27, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

opentelemetry-pr-dashboard Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

lmolkova Aug 28, 2026

Uh oh!

DylanRussell Aug 31, 2026

Uh oh!

lmolkova Aug 31, 2026

Uh oh!

DylanRussell Sep 1, 2026

Uh oh!

DylanRussell Sep 1, 2026

Uh oh!

Uh oh!

linux-foundation-easycla Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

DylanRussell commented Aug 31, 2026

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

DylanRussell commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Type of change

How has this been tested?

Checklist

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

opentelemetry-pr-dashboard Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pull request dashboard status

Uh oh!

lmolkova Aug 28, 2026

Choose a reason for hiding this comment

Uh oh!

DylanRussell Aug 31, 2026

Choose a reason for hiding this comment

Uh oh!

lmolkova Aug 31, 2026

Choose a reason for hiding this comment

Uh oh!

DylanRussell Sep 1, 2026

Choose a reason for hiding this comment

Uh oh!

DylanRussell Sep 1, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

linux-foundation-easycla Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

DylanRussell commented Aug 31, 2026

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

DylanRussell commented Aug 27, 2026 •

edited

Loading

opentelemetry-pr-dashboard Bot commented Aug 27, 2026 •

edited

Loading

linux-foundation-easycla Bot commented Aug 31, 2026 •

edited

Loading