Skip to content

feat: roll Python support to 3.11-3.15 and refresh dependencies - #241

Merged
rbell517 merged 2 commits into
masterfrom
agents/python-version-maintenance-and-updates
Oct 29, 2026
Merged

rbell517 merged 2 commits into
masterfrom
agents/python-version-maintenance-and-updates

Conversation

@rbell517

@rbell517 rbell517 commented Oct 29, 2026 •

Copy link
Copy Markdown
Collaborator

What does this Pull Request accomplish?

  • Roll certified CPython support from 3.10-3.14 to 3.11-3.15 across metadata, both CI matrices, release tooling, Read the Docs, and contributor/user documentation. Keep future Python 3.x installable (>=3.11,<4.0).
  • Fully regenerate the Poetry lock, including optional and interpreter-specific branches. Upgrade AnyIO from 4.11.0 to 4.15.1, resolving PYSEC-2026-4024 and PYSEC-2026-4025.
  • Keep pandas 2 and the existing Arrow range on Python 3.11-3.14; use native pandas 3.1 and optional Arrow 26 on Python 3.15+. These newer releases provide Python 3.15 wheels. Update exact DataFrame test expectations rather than emulating pandas 2 behavior or disabling dtype checks.
  • Upgrade pytest-asyncio for pytest 9 compatibility and Poe for Windows argument handling. Construct the existing Uplink response handler explicitly so its callback remains typed under the refreshed mypy.
  • Add concise repository Copilot guidance and a flat ADR index/lifecycle guide with selected/undecided templates. ADR-001 records why pandas majors are Python-specific: globally upgrading pandas would require customer-disruptive NbExec image upgrades. No initiatives, skills, or decision automation were added.
  • Enable the Arrow extra in existing integration CI while retaining max-parallel: 1 to avoid shared-service collisions.

Why should this Pull Request be merged?

Python 3.10 is end of life; the supported stable CPython window is now 3.11-3.15. This keeps the library current, removes known vulnerable lock resolutions, and makes the compatibility and development policies discoverable.

Compatibility notice: Python 3.10 is no longer supported. Moving to Python 3.15 also adopts native pandas 3 inference, including possible string dtype, timestamp-unit, and missing-value representation differences. Existing Python 3.11-3.14 environments retain pandas 2; no NbExec image upgrades are part of this PR.

Administrator follow-up after merge: the maintainer has removed the obsolete required Python 3.10 check. The existing required Python 3.11/3.12/3.13 and documentation checks remain; the maintainer will add 3.14/3.15 as required checks after this PR merges. This PR does not change repository settings or automatically merge.

What testing has been done?

Local validation used CPython 3.15.2 and Poetry 2.2.1:

Command Result
poetry lock --regenerate Passed; full constrained refresh, not retention of old resolutions
poetry check --lock Passed; existing Poetry metadata deprecation warnings remain
poetry install Passed; base imports worked and pyarrow was absent
poetry install --extras pyarrow Passed with pandas 3.1.0 and pyarrow 26.0.0; library/pandas/pyarrow/pydantic import smoke test passed
poetry run pytest tests\product\test_product_dataframe_utilities.py tests\spec\test_spec_dataframe_utilitites.py tests\testmonitor\test_testmonitor_dataframe_utilities.py -q --tb=short --disable-warnings Passed: 23 tests
poetry run poe test -q --tb=short --disable-warnings Passed: 399 tests and 29 subtests; 26 skipped without integration service configuration, 278 deselected
poetry run poe check Passed: 383 files unchanged; optional Jupyter formatting dependencies are not installed
poetry run poe lint Passed
poetry run poe types Passed: 383 source files; existing unrecognized Pydantic-plugin option warning remains
poetry build Passed: sdist and wheel
git diff --check Passed

Additional assertions passed for the wheel's exact Python floor/classifiers, Python-specific pandas/Arrow dependency markers, Arrow remaining optional, both CI matrices, integration serialization/extra installation, and ADR metadata/index/local links.

The complete lock was enumerated into fully pinned audit inputs without environment markers, splitting alternate versions of a package into separate inputs. Both final pip-audit commands below passed. Coverage was checked against the final lock: all 60 package/version pairs, including main/dev/optional/platform/Python branches, zero known vulnerabilities and zero skipped packages. The baseline covered 61 pairs and found only the two AnyIO advisories above. Inputs/reports stay outside the repository.

uvx --python 3.11 pip-audit --no-deps --disable-pip --strict --progress-spinner off -r audit-after-1.txt --format json --output audit-after-1.json
uvx --python 3.11 pip-audit --no-deps --disable-pip --strict --progress-spinner off -r audit-after-2.txt --format json --output audit-after-2.json

PR CI completed successfully in run 40928868327:

  • gh run watch 40928868327 --repo ni/nisystemlink-clients-python --interval 20 --exit-status - passed.
  • All five build-lint-unit-test jobs (Python 3.11-3.15) - passed.
  • All five serialized integration-test jobs (Python 3.11-3.15), with the Arrow extra installed - passed. Each ran 249 passing tests, 52 skipped, 402 deselected. Completed job logs confirm that the DataFrame integration suite ran.
  • Read the Docs Python 3.11 build - passed.
  • Wiz SAST Scanner and Wiz Vulnerability Scanner - passed.
  • Release - skipped as expected on a pull request.

The workflow's cloud API key argument was empty, so this is not evidence of credentialed Cloud coverage; the repository exposes an Enterprise API key but no repository-level CLOUD_API_KEY. Existing service/credential skips are reported above rather than counted as tested. Local skips likewise are not counted as integration verification.

Documentation/release tooling outside the Poetry lock is not represented as covered by the lock audit. That run completed with all emitted validation checks green. Normal review is still required; the obsolete required Python 3.10 check has now been removed.

Review follow-up in ed77cae moves the ADR index below its introduction, explains the pandas-major-specific timestamp expectations, and removes internal decision/deployment references from public user documentation. All three review threads have been replied to and resolved. The 23 targeted DataFrame tests, targeted Black/Flake8 checks, documentation assertions, and git diff --check passed locally. The new CI run is 40931290298; its results are pending.

Keep pandas 2 on existing Python versions and use native pandas 3 defaults on Python 3.15 to avoid forcing disruptive NbExec image upgrades. Record that policy in ADR-001 and introduce lightweight decision documentation and Copilot guidance.

Regenerate the full dependency lock to resolve known AnyIO advisories, update test tooling for compatibility, and exercise the optional Arrow extra in serialized integration CI.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Comment thread docs/decisions/README.md Resolved
Comment thread README.rst Resolved
Move the decision index before lifecycle guidance, explain pandas-major-specific timestamp expectations, and keep internal decision and deployment context out of public user documentation.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@rbell517
rbell517 merged commit 5b8f76e into master Oct 29, 2026
14 checks passed
@rbell517
rbell517 deleted the agents/python-version-maintenance-and-updates branch October 29, 2026 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants