Skip to content

[FEAT] Diagnostic combined-stdout console diff - #1266

Merged
canihavesomecoffee merged 1 commit into
CCExtractor:masterfrom
NaitikVerma6776:fix/1082-console-diff
Nov 16, 2026
Merged

canihavesomecoffee merged 1 commit into
CCExtractor:masterfrom
NaitikVerma6776:fix/1082-console-diff

Conversation

@NaitikVerma6776

Copy link
Copy Markdown
Contributor

Summary

  • Adds GET /api/v1/runs/{id}/console-diff so testers can compare a run's combined_stdout.log to another run (default: previous completed run on the same platform).
  • This is a diagnostic view only: it does not change CI pass/fail, XML, or goldens. Combined stdout is a whole-run VM log, not a per-test golden.
  • The web console exposes View diff on Combined stdout using the existing DiffDrawer (no playback).

Fixes #1082

Dheeraj asked whether console output should affect each regression-test verdict or stay a diagnostic comparison between runs; this PR takes the diagnostic slice.

Test plan

  • python -m unittest tests.api.test_routes_system.TestConsoleDiff tests.api.test_services_diff_service.TestDiffService
  • cd web && npm run lint && npx tsc -b
  • Open a finished run, Combined stdout → View diff, confirm unified output vs previous completed same-platform run
  • Confirm ?against=<run_id> works and that missing logs / no previous run return 404, not a verdict change

Compare a run's combined VM stdout to the previous completed same-platform run so testers can inspect printf/mprint changes without treating them as golden failures.
@sonarqubecloud

Copy link
Copy Markdown

@canihavesomecoffee
canihavesomecoffee merged commit d06d6a0 into CCExtractor:master Nov 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request] Check Console Diff

2 participants