Skip to content

Use Official Apache Arrow Flight SQL client for Duckflight and add S3 lake entries - #2733

Merged
alexey-milovidov merged 6 commits into
ClickHouse:mainfrom
nicosuave:duckflight-rust-lake
Oct 25, 2026
Merged

alexey-milovidov merged 6 commits into
ClickHouse:mainfrom
nicosuave:duckflight-rust-lake

Conversation

@nicosuave

@nicosuave nicosuave commented Oct 21, 2026 •

Copy link
Copy Markdown
Contributor

Updates Duckflight to DuckDB 2.0.0 and uses the Apache Arrow Rust client. Adds single-file and partitioned S3 data lake benchmarks, with new c6a.4xlarge results for all three entries.

@github-actions

Copy link
Copy Markdown
Contributor

@nicosuave nicosuave changed the title Use Rust for Duckflight and add S3 lake entries Use Official Apache Arrow Flight SQL client for Duckflight and add S3 lake entries Oct 21, 2026
@alexey-milovidov alexey-milovidov added the machine:all PR benchmark on every machine type label Oct 25, 2026
@alexey-milovidov
alexey-milovidov deployed to benchmark-approval October 25, 2026 11:49 — with GitHub Actions Active
…-datalake-partitioned (c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)
@github-actions

Copy link
Copy Markdown
Contributor

Results for duckflight are ready for: c6a.2xlarge, c6a.metal, c7a.metal-48xl, c8g.metal-48xl.
Results for duckflight-datalake are ready for: c6a.2xlarge, c6a.metal, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for duckflight-datalake-partitioned are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.metal-48xl.
The result files are committed as ed52fc0.
Removed manually added result files: duckflight-datalake-partitioned/results/20261021/c6a.4xlarge.json, duckflight-datalake/results/20261021/c6a.4xlarge.json, duckflight/results/20261021/c6a.4xlarge.json.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

…-datalake-partitioned (c6a.4xlarge, c6a.large, c6a.xlarge, c8g.4xlarge)
@github-actions

Copy link
Copy Markdown
Contributor

Results for duckflight are ready for: c6a.4xlarge, c6a.large, c6a.xlarge, c8g.4xlarge.
Results for duckflight-datalake are ready for: c6a.4xlarge, c6a.large, c6a.xlarge.
Results for duckflight-datalake-partitioned are ready for: c6a.large, c8g.4xlarge.
The result files are committed as cc22f9e.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for duckflight-datalake are ready for: t3a.small.
Results for duckflight-datalake-partitioned are ready for: t3a.small.
The result files are committed as cc9015a.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for duckflight are ready for: t3a.small.
The result files are committed as de19f0c.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

@alexey-milovidov
alexey-milovidov merged commit 1e41121 into ClickHouse:main Oct 25, 2026
2 of 3 checks passed

This branch is waiting to be deployed

1 waiting deployment
benchmark-approval — de19f0c9 Waiting Oct 25, 2026 by robot-clickhouse via launch #894
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

machine:all PR benchmark on every machine type

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants