Site: Add blog post for iceberg-rust 0.10.0 - #17032
Conversation
|
This is currently in draft as the release candidate voting is ongoing. @CTTY can you provide a review? |
89b4986 to
1735336
Compare
|
|
||
| ## Release Highlights | ||
|
|
||
| There has been plenty of contributions across the `iceberg-rust` library, here's a highlight of a few. |
There was a problem hiding this comment.
| There has been plenty of contributions across the `iceberg-rust` library, here's a highlight of a few. | |
| There have been plenty of contributions across the `iceberg-rust` library; here's a highlight of a few. |
mbutrovich
left a comment
There was a problem hiding this comment.
Just minor nits on a first pass. Thanks @dannycjones!
dannycjones
left a comment
There was a problem hiding this comment.
Sorry all, this draft didn't meet the right bar. Thank you all for the feedback, I've done a much deeper review of the changes mentioned and have pushed an update.
CTTY
left a comment
There was a problem hiding this comment.
Thanks Danny for writing up the blog!
|
|
||
| ### Writer Improvements | ||
|
|
||
| - **Content-defined chunking** ([#2375](https://github.com/apache/iceberg-rust/pull/2375), [#2561](https://github.com/apache/iceberg-rust/pull/2561)): CDC table properties are now respected for optimizing Parquet file boundaries |
There was a problem hiding this comment.
- **Content-defined chunking(CDC)**
This is more explicit, I keep thinking about change data capture when seeing "CDC" :D
There was a problem hiding this comment.
I've opted to just spell it out for clarity in the new commit (about to push)
|
|
||
| ### Custom Runtime Support | ||
|
|
||
| The [`Runtime` trait](https://github.com/apache/iceberg-rust/pull/2308) can now be injected into catalogs, decoupling `iceberg-rust` from a hard tokio dependency at the catalog layer. This enables embedding in applications with custom async runtimes. |
There was a problem hiding this comment.
decoupling
iceberg-rustfrom a hard tokio dependency at the catalog layer. This enables embedding in applications with custom async runtimes.
This is inaccurate, Runtime is still a struct in iceberg-rust. users can now inject a customized tokio Runtime using the runtime api, but they cannot easily plug in a customized non-tokio runtime
There was a problem hiding this comment.
Thanks for calling this out, totally misunderstood.
I'm going to update it something like this:
This allows for injecting a customized Tokio runtime into the session.
For example, it is now possible to configure the thread stack size or maximum number of threads.
|
|
||
| - **Table encryption**: With the foundational encryption stack landed, the community is working toward end-to-end encrypted reads and writes | ||
| - **Additional commit types**: Support for `RewriteDataFiles`, `RowDelta`, and `Overwrite` commit operations | ||
| - **Extensibility**: Continued investment in abstractions for pluggable storage backends and runtime configuration |
There was a problem hiding this comment.
I'll remove it for now. What I had in mind was further storage trait work, such as extending to object_store. That being said, the work hasn't started so I'll omit it for this post.
|
Thanks all, iceberg-rust 0.10.0 is now out! I've updated the post. It should be ready to merge, pending addressing any review feedback. |
|
Do we want to wait for 0.10.1 at this point? |
I was wondering the same. Personally, I don't think so, however I'm also happy to make a few small changes if needed and ship it once 0.10.1 is out (if the patch is needed for the crates). If we do wait for 0.10.1, my thinking would be to make it a "0.10" blog post rather than "0.10.0", especially since that's the cadence we're more interested in. Let me know what you think, I'm happy with either outcome. |
I dont think we necessary have to wait... the rust crates are available already. 0.10.1 is just fixing I'd like to move forward, this has been opened for a while 😄 |
|
Sounds good to me, let's ship! |
Sounds good, I misread the email chain and thought crates had an issue and were pulled as well. |
CTTY
left a comment
There was a problem hiding this comment.
LGTM overall! Just one minor comment
Co-authored-by: Shawn Chang <yxchang@amazon.com>
|
I plan to press the button tomorrow morning (unless someone beats me to it 😄 ) |

This blog post announces the 0.10.0 release of iceberg-rust (apache/iceberg-rust#2527).
The content is an AI-assisted summary. I've reviewed the content and adjusted some items that were misleading.
I've generated the blog locally and reviewed that everything renders OK.