Skip to content

Build: Bump pyspark[connect] from 4.0.1 to 4.2.0 - #3704

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/uv/pyspark-connect--4.2.0
Open

Build: Bump pyspark[connect] from 4.0.1 to 4.2.0#3704
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/uv/pyspark-connect--4.2.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Jul 24, 2026

Copy link
Copy Markdown
Contributor

Bumps pyspark[connect] from 4.0.1 to 4.2.0.

Commits
  • 32f7299 Preparing Spark release v4.2.0-rc6
  • 7a25c75 [SPARK-56972][SS][FOLLOWUP] Reject sink evolution combined with async progres...
  • 44daf01 [SPARK-58024][PYTHON] Convert Arrow struct and map columns to Python rows in ...
  • d0856c7 [SPARK-58019][PYTHON] Convert Arrow list columns to Python rows in bulk
  • e79fd9b [MINOR][UI][4.2] Encode query parameters when generating log page scripts
  • fc46f2a [SPARK-57962][PYTHON] Guard against path traversal in install_spark tar extra...
  • 380776d [MINOR][UI] Escape HTML when rendering error messages in the Web UI tables
  • c40f044 [SQL] Allow more control over UDT creation during input loading
  • 5a347f9 [SPARK-58042][CONNECT] Validate the UDT jvm_class is a UserDefinedType before...
  • e3c6298 [SPARK][SQL] LDAP Thriftserver improvement
  • Additional commits viewable in compare view

Note
Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Jul 24, 2026
@ebyhr

ebyhr commented Jul 25, 2026

Copy link
Copy Markdown
Member
=========================== short test summary info ============================
ERROR tests/integration/test_add_files.py::test_add_files_to_unpartitioned_table[format_version=1] - FutureWarning: PySpark does not yet fully support pandas >= 3.0.0. Some features may not work correctly. It is recommended to use pandas < 3.0.0 for now.
!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!
====================== 3922 deselected, 1 error in 19.76s ======================

@kevinjqliu

Copy link
Copy Markdown
Contributor

i think we can skip this for now

Bumps [pyspark[connect]](https://github.com/apache/spark) from 4.0.1 to 4.2.0.
- [Commits](apache/spark@v4.0.1...v4.2.0)

---
updated-dependencies:
- dependency-name: pyspark[connect]
  dependency-version: 4.2.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/uv/pyspark-connect--4.2.0 branch from fcac58c to 1e70557 Compare August 10, 2026 16:52
@Fokko

Fokko commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

I think we should bump Spark altogether to 4.1. There is Spark 4.1 support for Iceberg Java 1.11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants