Skip to content

[#918 S0c] Harness: workload generator, scoreboard, watermark endpoint, perf capture #923

Open

Description

@milindsrivastava1997
  • Suite YAML → planner workload (one source of truth for both engines).
  • Scoreboard per query × engine: answered-correct / answered-wrong / not answered (reason), from x-asap-execution. Forwarded never counts as a pass.
  • Watermark barrier endpoint; tests seed past data, start with --stream-start-ms, send barrier instead of sleeping.
  • External perf capture (ingest throughput, query latency, CPU, RSS) → JSON artifact per run.

Done when: legacy engine produces a scoreboard + perf artifact in CI.

Part of #918. PR conventions: see #918 "PR stack".

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions