feat: custom Rust UDFs via arrow-ffi [experimental] - #4459

Open

andygrove wants to merge 17 commits into

apache:mainfrom

andygrove:feat/rust-udfs-arrow-ffi

Commits on May 27, 2026

feat: custom Rust UDFs via arrow-ffi (alternative to #4283) [skip ci]
andygrove
committed
ae3983b

Commits on Aug 4, 2026

Merge remote-tracking branch 'apache/main' into feat/rust-udfs-arrow-ffi
andygrove
committed
83b1f65
feat: drop datafusion-ffi flavor, contain panics at the FFI boundary, add user guide
andygrove
committed
0f35933
refactor: remove the write-only spark.comet.rustUdfs conf
andygrove
committed
80d2cba
feat: cover all non-nested Spark types, validate the declared return type
andygrove
committed
ce1b0e4
feat: support complex types, compare return types ignoring nested nullability
andygrove
committed
299c16f
ci: run CometRustUdfSuite in the PR builds
andygrove
committed
1d2e60e
style: drop redundant string interpolators in the Rust UDF messages
andygrove
committed
d8b8f09
Merge branch 'main' into feat/rust-udfs-arrow-ffi
andygrove
authored
ac735a1
fix: drop a loaded UDF library after its kernels, not before
andygrove
committed
5156b77
fix(ci): build the test UDF cdylib before the Rust test run
andygrove
committed
f20bc31
fix: reject deterministic = false when registering a Rust UDF
andygrove
committed
3e999c4
docs: clarify the Rust UDF ABI's stability, purity, and path resolution
andygrove
committed
ceb9365

Commits on Aug 7, 2026

Commits on Aug 12, 2026

Merge remote-tracking branch 'apache/main' into feat/rust-udfs-arrow-ffi
andygrove
committed
0689207