Skip to content

test: skip agent e2e when LLM budget is exhausted#145

Merged
ling-senpeng13 merged 1 commit into
mainfrom
fix/agent-e2e-llm-budget
Jul 24, 2026
Merged

test: skip agent e2e when LLM budget is exhausted#145
ling-senpeng13 merged 1 commit into
mainfrom
fix/agent-e2e-llm-budget

Conversation

@ling-senpeng13

Copy link
Copy Markdown
Contributor

Summary

  • add a Jest E2E results processor that converts only the provider's explicit API usage-limit failures to pending tests
  • recompute suite and aggregate counts so unrelated failures still fail mixed runs
  • add focused coverage for budget-only and mixed-failure results

Validation

  • focused processor tests pass
  • npm run lint completes with 0 errors (existing warnings remain)
  • Jest E2E config resolves the processor successfully
  • git diff --check passes

Environment limitations

  • the full unit suite is blocked locally on Node 26.3.0 by the existing Poller.ts path failing with ReferenceError: clearTimeout is not defined; CI uses Node 22
  • examples require a live Conductor server and .env credentials, which are not present in this checkout

JavaScript counterpart to conductor-oss/python-sdk#445 and conductor-oss/java-sdk#141.

@codecov

codecov Bot commented Jul 23, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

Flag Coverage Δ
integration-v4-sm 41.54% <ø> (+0.01%) ⬆️
integration-v5-sdkdev 44.05% <ø> (+0.14%) ⬆️
unit 73.84% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1 file with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ling-senpeng13
ling-senpeng13 merged commit 731d614 into main Jul 24, 2026
72 of 79 checks passed
ling-senpeng13 added a commit that referenced this pull request Jul 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants