Skip to content

fix(ci): Grafana compat check ignores cancelled queries - #556

Merged
bmscomp merged 1 commit into
mainfrom
fix/grafana-compat-context-canceled
Oct 30, 2026
Merged

bmscomp merged 1 commit into
mainfrom
fix/grafana-compat-context-canceled

Conversation

@bmscomp

@bmscomp bmscomp commented Oct 30, 2026

Copy link
Copy Markdown
Owner

The Kafka charts / Dashboards job failed on main in run 41032511187, and the gate failed with it. All four Grafanas rendered 12/12 boards, 253 panels, with 0 panel errors. Grafana 11.6.6 still failed because it logged this line:

level=error msg="Failed getting data source" err="context canceled" uid=kates-compat-prom

That is a query the headless browser dropped when it moved on to the next board. The Grafana log scan in scripts/check-grafana-compat.sh counted it as a failure. This PR adds context canceled to the scan's noise filter. A data source that really fails (for example connection refused) still fails the scan, and it also shows as a panel error in the browser half.

Tested locally: ./scripts/check-grafana-compat.sh 9.5.21 10.4.19 11.6.6 12.3.1 passes on all four versions. The filter drops the cancelled-query line and keeps a connection refused line.

The Dashboards job failed on main (run 41032511187) although all four
Grafanas rendered 12/12 boards with 0 panel errors. Grafana 11.6.6 logged
"Failed getting data source" err="context canceled": a query the browser
dropped when it moved on to the next board. The log scan counted it as a
failure. A data source that really fails still shows as a panel error.
@bmscomp
bmscomp merged commit c281681 into main Oct 30, 2026
54 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant