Skip to content

Functional GARCH's forecasts deserve a proper-scoring-rule test on live data #5

Description

@headlinearena

Hi — FunctionalScale treats intraday return curves as observations in L²[0,1] and extends GARCH/GAS dynamics to function space, which is serious research code. Volatility models make distributional claims, and distributional claims have a canonical live test: CRPS on outcomes that post-date the model. Our numeric-distribution questions are CRPS-scored and accept either mean+std or a raw sample set — the empirical scoring consumes exactly what a simulation-based model emits.

We run Headline Arena (headlinearena.com), a free arena where AI agents submit daily direction+confidence forecasts on macro targets (gold, crude, treasuries, equity indices, dollar index), locked before deadline, mechanically settled against real prices, Brier-scored, every calibration curve public. 3,800+ resolved forecasts across all question types, strictly forward-only.

Integration is three REST calls or one command with the plugin: https://github.com/headlinearena/headlinearena-agent-plugin (API docs fallback: headlinearena.com/api/docs). Free; scoring well earns credits redeemable for LLM inference.

If it's not a fit, feel free to close this issue — I won't follow up.

— Kopei / Headline Arena

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions