Skip to content

acc: record config edge cases for variables, YAML merge keys and diagnostic locations - #7029

Merged
denik merged 8 commits into
mainfrom
denik/acc-config-edge-cases
Oct 14, 2026
Merged

denik merged 8 commits into
mainfrom
denik/acc-config-edge-cases

Conversation

@denik

@denik denik commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Changes

New acceptance tests that record current behaviour of config edge cases, so the libs/dyn removal (#6954) can't change it silently:

  • variables: complex array defaults merged across includes; target shorthands through YAML aliases and merge keys; <<: [*a, *b] precedence; full definitions through a merge key; complex values from variable-overrides.json with relative paths.
  • YAML: nested anchor cycle error.
  • diagnostics: compute_id deprecation locations; errors on target-overridden values point at the effective setting (engine, trigger_pause_status, name_prefix); required-field errors for dashboard keys with special characters; development: ${...} deprecation warning.
  • jobs: explicit empty task source in a git-backed job; bundle run resolving run_job_task.job_id: ${resources.jobs.x.id}.

Some recorded behaviour looks wrong on main (merge-key precedence is the reverse of the YAML spec; relative paths in variable-overrides.json resolve differently for task files and libraries; target compute_id is reported for unselected targets). The tests record it as is; fixes are separate.

Tests

New tests only, no code changes.

This pull request and its description were written by Isaac.

denik and others added 2 commits October 12, 2026 17:12
…nostic locations

Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions github-actions Bot added the DABs DABs related issues label Oct 12, 2026
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: cd981bc

Run: 38569529502

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 276 27 7:41
✅​ aws-windows-latest-4core-16gb 278 25 6:07
✅​ azure linux-2core-8gb 275 27 6:46
✅​ azure-windows-latest-4core-16gb 277 25 7:35
✅​ gcp linux-2core-8gb 276 27 7:35
✅​ gcp-windows-latest-4core-16gb 278 25 7:37
Top 5 slowest tests (at least 2 minutes):
duration env testname
6:53 azure-windows-latest-4core-16gb TestAccept
3:57 aws-windows-latest-4core-16gb TestAccept
3:52 gcp-windows-latest-4core-16gb TestAccept
2:23 azure-windows-latest-4core-16gb TestSetupLocalServerlessProvision
2:02 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir

denik and others added 4 commits October 13, 2026 11:27
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@@ -0,0 +1 @@
Badness = "With <<: [*a, *b] the later anchor wins; the YAML merge key spec gives precedence to the earlier one."

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://yaml-online-parser.appspot.com/?yaml=a%3A%20%26a%0A%20%20x%3A%20from-a%0Ab%3A%20%26b%0A%20%20x%3A%20from-b%0Amerged%3A%0A%20%20%3C%3C%3A%20%5B%2Aa%2C%20%2Ab%5D%0A&type=json

@pietern I wonder if we should change this.

Library Version merged.x Follows spec
go.yaml.in/yaml/v3 (used by the CLI) v3.0.5 from-a yes
gopkg.in/yaml.v3 v3.0.1 from-a yes
gopkg.in/yaml.v2 v2.4.0 from-a yes
sigs.k8s.io/yaml (wraps yaml.v2) v1.6.0 from-a yes
github.com/goccy/go-yaml v1.19.2 from-b no
PyYAML (yaml.safe_load) latest via uv from-a yes
yaml-online-parser — from-a yes
Databricks CLI on main (libs/dyn/yamlloader) — from-b no

…ript

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik marked this pull request as ready for review October 14, 2026 12:46
@denik
denik requested review from a team as code owners October 14, 2026 12:46
@denik
denik requested a review from andrewnester October 14, 2026 12:46
@denik
denik enabled auto-merge October 14, 2026 12:58
…recorded

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik added this pull request to the merge queue Oct 14, 2026
Merged via the queue into main with commit 420f886 Oct 14, 2026
25 checks passed
@denik
denik deleted the denik/acc-config-edge-cases branch October 14, 2026 13:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants