Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
a3e9e51
feat(python): capture typed framework media with one upload per trace
nik13 Nov 11, 2026
528ec08
ci(python): framework attachments floor uses the openai floor pydanti…
nik13 Nov 11, 2026
cd4e60b
fix(python): scope attachment claims to the manager with a short TTL
nik13 Nov 11, 2026
a8e9e07
test(python): claim expiry test uses the claim table's own clock
nik13 Nov 11, 2026
47ba30d
ci(python): framework attachments floor pins OpenTelemetry below 1.39…
nik13 Nov 11, 2026
2ea6773
test(python): keep floor-only SDK limits out of the framework attachm…
nik13 Nov 11, 2026
3ad8103
test(python): skip the pydantic-ai fork exit probe only on pydantic-a…
nik13 Nov 11, 2026
9a3c7ca
fix(python): one occurrence per observing span; tool results fold bot…
nik13 Nov 11, 2026
2eae067
ci(python): name the provider-and-framework tests in the frameworks w…
nik13 Nov 11, 2026
d1d1801
fix(python): never read a denied framework bytes part; correct two oc…
nik13 Nov 11, 2026
8069389
test(python): do not assume upload order across two spans
nik13 Nov 12, 2026
3fe575c
feat(python): share the per-call capture-policy and owner context keys
nik13 Nov 12, 2026
16311a3
feat(python): one model call, one owner for the framework adapters
nik13 Nov 12, 2026
1080f58
fix(python): treat a stream proxy with both protocols as async when m…
nik13 Nov 12, 2026
2296837
fix(python): mark a framework model call only when the adapter observ…
nik13 Nov 12, 2026
a2a007f
test(python): one owner per call with traceai_anthropic under LangChain
nik13 Nov 12, 2026
66c4371
test(python): pin each provider-side owner check and the Pydantic AI …
nik13 Nov 12, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
89 changes: 89 additions & 0 deletions .github/workflows/attachments-python-frameworks-tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,89 @@
name: Python framework attachments

# Real LangChain, LlamaIndex, Agno and Pydantic AI (declared floor and latest) through
# the Python framework instrumentors to a TLS loopback F01 attachment server, with and
# without traceai_openai (and traceai_anthropic under LangChain) on the same manager.
# Outbound network is disabled while the tests run.

on:
pull_request:
paths:
- 'python/fi_instrumentation/attachments/**'
- 'python/frameworks/langchain/**'
- 'python/frameworks/llama_index/**'
- 'python/frameworks/agno/**'
- 'python/frameworks/pydantic-ai/**'
- 'python/frameworks/openai/**'
- 'python/frameworks/anthropic/**'
- 'python/tests/attachments_frameworks/**'
- 'python/tests/attachments_providers/conftest.py'
- '.github/workflows/attachments-python-frameworks-tests.yml'
push:
branches: [dev]
paths:
- 'python/fi_instrumentation/attachments/**'
- 'python/frameworks/langchain/**'
- 'python/frameworks/llama_index/**'
- 'python/frameworks/agno/**'
- 'python/frameworks/pydantic-ai/**'
- 'python/frameworks/openai/**'
- 'python/frameworks/anthropic/**'
- 'python/tests/attachments_frameworks/**'
- 'python/tests/attachments_providers/conftest.py'
- '.github/workflows/attachments-python-frameworks-tests.yml'
workflow_dispatch:

permissions:
contents: read

jobs:
frameworks:
name: Framework attachments (${{ matrix.name }})
runs-on: ubuntu-24.04
timeout-minutes: 25
strategy:
fail-fast: false
matrix:
include:
# Declared floors (ChatMessage blocks need llama-index-core 0.12.3+). pydantic-ai 0.1.0 imports
# opentelemetry._events, which OpenTelemetry API 1.39+ no longer ships; Agno imports fastapi.
- name: floor
python: '3.10'
sdks: >-
langchain-core==0.2.43 llama-index-core==0.12.41 agno==2.7.2
openinference-instrumentation-agno==1.1.0 pydantic-ai-slim[openai]==0.1.0 openai==1.74.0 anthropic==0.41.0
fastapi 'httpx<0.28' 'opentelemetry-api>=1.28,<1.39' 'opentelemetry-sdk>=1.28,<1.39'
# Latest releases, including the framework OpenAI and Anthropic integrations for the
# provider-and-framework tests.
- name: latest
python: '3.12'
sdks: >-
langchain-core==1.8.0 langchain-openai==1.7.4 llama-index-core==0.14.25
llama-index-llms-openai==0.8.4 agno==3.1.12 openinference-instrumentation-agno==1.1.0
pydantic-ai-slim[openai]==2.67.0 langchain-anthropic==1.7.10 anthropic==2.8.0 fastapi
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
- uses: actions/setup-python@a26af69be951a213d495a4c3e4e4022e16d87065 # v5.6.0
with:
python-version: ${{ matrix.python }}
- name: Install source integrations and the selected frameworks
env:
SDKS: ${{ matrix.sdks }}
run: |
python -m venv .venv
# shellcheck disable=SC2086
eval .venv/bin/pip install -e python -e python/frameworks/openai -e python/frameworks/anthropic \
-e python/frameworks/langchain \
-e python/frameworks/llama_index -e python/frameworks/agno -e python/frameworks/pydantic-ai \
opentelemetry-sdk "'pytest>=7,<9'" $SDKS
.venv/bin/pip freeze | grep -iE '^(langchain|llama-index-core|llama-index-llms|agno|pydantic-ai|openai|anthropic|openinference)' || true
- name: Run with outbound network disabled
run: |
sudo unshare --net -- bash -e -c '
ip link set lo up
cd "$2/python"
AGNO_TELEMETRY=false PYTHONPATH=. "$1" -m pytest tests/attachments_frameworks -q -p no:cacheprovider \
-o addopts="" -o faulthandler_timeout=120
' _ "$PWD/.venv/bin/python" "$PWD"
Loading
Loading