Repository navigation
Add explicit AIRO agentic forecasting harness - #30
Closed
jordan-c-olm wants to merge 1 commit into
Closed
jordan-c-olm wants to merge 1 commit into
jordan-c-olm wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
utils.llm.agentic.run(...)so callers can explicitly use AIRO's existing pi forecasting harness from fri-utils. The caller supplies prompts and forecast schemas; results include cells, evidence, usage, and trace artifacts. ExistingModelRun.get_response(...)calls and registry identities remain unchanged.This PR copies the core from AIRO commit
3ece40dfa87961c4fb03f826d007ed4e3d42b1f9. AIRO keeps its separate version. ForecastBench runs, DWH integration, and consumer migrations are deferred.Key decisions
Validation
make lintpasses.PYTHONPATHunset, exercising packaged TypeScript, the Python research tool, and validator retries.-W 'ignore:Python 3.14 will, by default:DeprecationWarning'. Plainmake testhas three existing archive-test failures on Python 3.13; all three reproduce on unchanged main.Reported usage still covers only the returned attempt and excludes Tavily charges. Turn and timeout limits are not dollar caps. Other platforms retain process-only timeout termination.
Setup and runbook
See the setup guide for copy-paste commands and one bounded example.
npm ci.FORECASTER_PIto that runtime'scli.js. SetFORECASTER_MODELto the selected piprovider/model-id.OPENAI_API_KEYorANTHROPIC_API_KEY) andTAVILY_API_KEY. Load local.envexplicitly withload_dotenv(".env", override=False), or inject deployment secrets under those names. GCPAPI_KEY_*secrets must be mapped to these environment names;configure_api_keys(from_gcp=True)does not pass its in-memory keys to pi.FRI_REQUIRE_PI=1 pytest tests/unit/agenticfor offline validation. For a live check, use the guide's explicit 1-question, 180-second, zero-retry example and inspect errors, missing cells, evidence, and actual cost.