Skip to content

feat(visualization): export the charts that draw over a table's columns - #8365

Draft
kz930 wants to merge 3 commits into
apache:mainfrom
kz930:feat/standalone-viz-a2
Draft

feat(visualization): export the charts that draw over a table's columns#8365
kz930 wants to merge 3 commits into
apache:mainfrom
kz930:feat/standalone-viz-a2

Conversation

@kz930

@kz930 kz930 commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this PR?

Sixteen plots whose shape comes from the columns they are pointed at: the
bar, line and pie, the histograms, the scatter family, the box and violin,
the strip and the ECDF, the heat map, the candlestick, the funnel and the
dot plot.

A line's series configuration and an error band's are one type extending
the other, so they travel together.

Any related issues, documentation, discussions?

Part of #8325, 11 of 21; that issue lists the set in order. It needs #8327 for the trait, so it does not compile until that lands, and the rows these operators add to the verification runner follow with the harness rather than as whole new files here.

Closes #8417, the task this change is the whole of.

How was this PR tested?

Each operator asserts the block it emits in its own spec. Once the harness lands, each is also run through the engine and through its generated script, on every configuration its schema offers, and the two answers compared.

Was this PR authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Opus 5)

Sixteen plots whose shape comes from the columns they are pointed at: the
bar, line and pie, the histograms, the scatter family, the box and violin,
the strip and the ECDF, the heat map, the candlestick, the funnel and the
dot plot.

A line's series configuration and an error band's are one type extending
the other, so they travel together.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Automated Reviewer Suggestions

Based on the git blame history of the changed files, we recommend the following reviewers:

  • Contributors with relevant context: @eugenegujing, @aglinxinyuan
    You can notify them by mentioning @eugenegujing, @aglinxinyuan in a comment.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

📊 Arrow Flight E2E bench

(no arrow-flight-e2e.csv in artifact)

Full dashboard · Workflow run

@codecov-commenter

codecov-commenter commented Sep 2, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.10%. Comparing base (7976744) to head (4056463).
⚠️ Report is 18 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #8365      +/-   ##
============================================
- Coverage     94.11%   94.10%   -0.02%     
- Complexity     4811     4842      +31     
============================================
  Files          1197     1203       +6     
  Lines         48813    48951     +138     
  Branches       5906     5930      +24     
============================================
+ Hits          45939    46063     +124     
+ Misses         1420     1419       -1     
- Partials       1454     1469      +15     
Flag Coverage Δ *Carryforward flag
access-control-service 81.00% <ø> (ø)
agent-service 99.32% <ø> (ø) Carriedforward from c7f4f1b
amber 90.07% <ø> (-0.01%) ⬇️ Carriedforward from c7f4f1b
computing-unit-managing-service 73.67% <ø> (ø)
config-service 87.12% <ø> (+0.12%) ⬆️
file-service 87.91% <ø> (ø)
frontend 96.86% <ø> (ø) Carriedforward from c7f4f1b
notebook-migration-service 83.57% <ø> (+4.26%) ⬆️
pyamber 98.47% <ø> (ø) Carriedforward from c7f4f1b
workflow-compiling-service 77.19% <ø> (ø) Carriedforward from c7f4f1b

*This pull request uses carry forward flags. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bubble Chart and Histogram 2D change in1df with dropna in place. This can change data used by another branch of the exported workflow. Please keep the input unchanged and test a shared upstream DataFrame.

@kz930
kz930 marked this pull request as draft September 4, 2026 17:12
The translator no longer emits plotly into every script; it asks the operators
in the plan what they need beyond pandas. All sixteen charts here draw with
plotly, so all sixteen mix in `PlotlyStandaloneCode`, which the hierarchy and
graph charts introduce.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The input DataFrame mutation issue from my previous review is still present.

…d over

Bubble Chart and Histogram 2D dropped rows in place; Bar Chart and the
Box/Violin plot rebound the name. All four now bind their own frame.

The translator names a variable per output PORT, not per reader, so two charts
drawn from one upstream are handed the same name. A chart that drops its own
nulls through that name leaves the chart beside it drawing a table it never
received, and a single-branch workflow never notices.

Both spellings did it. `inplace=True` mutates the frame outright, and
`in1df = in1df.dropna(...)` reads like a local rebinding but renames the shared
variable, since the operator bodies are concatenated at module scope.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@kz930

kz930 commented Sep 4, 2026

Copy link
Copy Markdown
Contributor Author

Fixed. Bubble Chart, Histogram 2D, Bar Chart and the Box/Violin plot now bind their own frame instead of writing to the input. Covered by the same check over every operator, which comes with the verification runner.

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The charts now use a separate frame. This fixes the branch data issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Export the charts that draw over a table's columns

3 participants