Skip to content

feat(visualization): export the tables, ranges and embedded documents - #8366

Draft
kz930 wants to merge 3 commits into
apache:mainfrom
kz930:feat/standalone-viz-a3
Draft

feat(visualization): export the tables, ranges and embedded documents#8366
kz930 wants to merge 3 commits into
apache:mainfrom
kz930:feat/standalone-viz-a3

Conversation

@kz930

@kz930 kz930 commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this PR?

Nine of them, and what they have in common is that the output is not a plot
drawn from numbers: a table rendered as a figure, a range a reader moves, an
image or an HTML document passed through, and the waterfall, which reads as a
chart but is built by accumulating rows rather than plotting them.

The waterfall plots every row and appends the total as a bar of its own,
rather than consuming the last row to make one.

Any related issues, documentation, discussions?

Part of #8325, 12 of 21; that issue lists the set in order. It needs #8327 for the trait, so it does not compile until that lands, and the rows these operators add to the verification runner follow with the harness rather than as whole new files here.

Closes #7974.

Closes #8418, the task this change is the whole of.

How was this PR tested?

Each operator asserts the block it emits in its own spec. Once the harness lands, each is also run through the engine and through its generated script, on every configuration its schema offers, and the two answers compared.

Was this PR authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Opus 5)

Nine of them, and what they have in common is that the output is not a plot
drawn from numbers: a table rendered as a figure, a range a reader moves, an
image or an HTML document passed through, and the waterfall, which reads as a
chart but is built by accumulating rows rather than plotting them.

The waterfall plots every row and appends the total as a bar of its own,
rather than consuming the last row to make one.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Automated Reviewer Suggestions

Based on the git blame history of the changed files, we recommend the following reviewers:

  • Contributors with relevant context: @eugenegujing
    You can notify them by mentioning @eugenegujing in a comment.

@codecov-commenter

codecov-commenter commented Sep 2, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.10%. Comparing base (7976744) to head (52f04ef).
⚠️ Report is 13 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #8366      +/-   ##
============================================
- Coverage     94.11%   94.10%   -0.02%     
- Complexity     4811     4849      +38     
============================================
  Files          1197     1203       +6     
  Lines         48813    48956     +143     
  Branches       5906     5930      +24     
============================================
+ Hits          45939    46068     +129     
+ Misses         1420     1419       -1     
- Partials       1454     1469      +15     
Flag Coverage Δ *Carryforward flag
access-control-service 81.00% <ø> (ø) Carriedforward from ab5ea74
agent-service 99.32% <ø> (ø) Carriedforward from ab5ea74
amber 90.07% <ø> (-0.01%) ⬇️ Carriedforward from ab5ea74
computing-unit-managing-service 73.67% <ø> (ø) Carriedforward from ab5ea74
config-service 87.12% <ø> (+0.12%) ⬆️ Carriedforward from ab5ea74
file-service 87.91% <ø> (ø) Carriedforward from ab5ea74
frontend 96.86% <ø> (ø) Carriedforward from ab5ea74
notebook-migration-service 83.57% <ø> (+4.26%) ⬆️
pyamber 98.47% <ø> (ø) Carriedforward from ab5ea74
workflow-compiling-service 77.19% <ø> (ø) Carriedforward from ab5ea74

*This pull request uses carry forward flags. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

📊 Arrow Flight E2E bench

(no arrow-flight-e2e.csv in artifact)

Full dashboard · Workflow run

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The table and embedded output exports look good.

@kz930
kz930 marked this pull request as draft September 4, 2026 17:12
The translator no longer emits plotly into every script; it asks the operators
in the plan what they need beyond pandas. Five of the nine here draw with
plotly and mix in `PlotlyStandaloneCode`, which the hierarchy and graph charts
introduce.

The other four state nothing, which is the point of asking: an image, an HTML
document, a nested table and a passed-through URL name none of plotly's
modules, so a script built from them runs wherever pandas is installed.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I checked the new import declarations. They look good.

Figure Factory Table imports `plotly.figure_factory` inside its own generated code, and
uses none of the three modules the mixin declares. Mixing it in would put an
import in the script that the script never reads.

The mixin states what a script has to import at module scope. An operator that
imports what it needs inside its own code has nothing to add there.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@carloea2 carloea2 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The import cleanup looks good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Export the tables, ranges and embedded documents Waterfall Chart consumes the last data row as its total bar, so that row's value is never plotted

3 participants