Repository navigation

GH-55263: [Python][Annotations] Add internal types and core data structures - #55264

Draft

rok wants to merge 93 commits into

apache:mainfrom

rok:pyarrow-stubs-pr3-core-data-sans-generic

Draft

GH-55263: [Python][Annotations] Add internal types and core data structures#55264
rok wants to merge 93 commits into
apache:mainfrom
rok:pyarrow-stubs-pr3-core-data-sans-generic

Commits on Nov 9, 2026
- Add internal types and helpers
  rok
  committed
  9404659
- Update python/pyarrow-stubs/pyarrow/_stubs_typing.pyi
  
  rok
  and
  dangotbanned
  committed
  5f7cdc8
- post rebase changes
  rok
  committed
  610c48d
- linting and formatting
  rok
  committed
  7bd5d7c
- add pyi check to pre-commit
  rok
  committed
  2f1a0ba
- ruff format
  rok
  committed
  42ab12d
- Apply suggestions from code review
  
  rok
  and
  dangotbanned
  committed
  675ae64
- review feedback
  rok
  committed
  14b924b
- Decimals should be covariant
  rok
  committed
  4ec84e4
- fix editable install collisions
  rok
  committed
  235c90d
- review feedback
  rok
  committed
  046fd11
- move placeholder
  rok
  committed
  0454fb9
- post rebase
  rok
  committed
  e6bc69b
- Apply suggestions from code review
  
  rok
  and
  dangotbanned
  committed
  a33f327
- Update python/pyarrow-stubs/pyarrow/_types.pyi
  
  rok
  and
  dangotbanned
  committed
  ca9441c
- update
  rok
  committed
  dbc4e40
- lint
  rok
  committed
  d2cc882
- more covariant types
  rok
  committed
  dce40ae
- Apply suggestions from code review
  
  rok
  and
  Copilot
  committed
  f278750
- lint
  rok
  committed
  ca7c54e
- Add type stubs for core data structures
  rok
  committed
  c032596
- temporary
  rok
  committed
  3df0567
- post rebase
  rok
  committed
  c990f32
- Use plain classes and unions instead of generics in stubs
  rok
  committed
  cffdf24
- Add tests for the type annotations of public APIs
  rok
  committed
  bb8681e
- Add placeholder stub for pyarrow._ipc
  rok
  committed
  376407d
- Skip type checking of modules that aren't annotated yet
  rok
  committed
  bc27123
- Fix stub annotations that don't match the runtime
  rok
  committed
  ddd9cb4
- Fix test_timedelta_overflow for sub-unit truncation
  rok
  committed
  92250c5
- Keep RecordBatchReader as Any until it gets annotated
  rok
  committed
  9636e5c
- Use TypeGuard for is_fixed_size_binary()
  rok
  committed
  4abbecc
- Test indexing of arrays, chunked arrays and tables
  rok
  committed
  325ed1d
- Add manual pre-commit hooks for linting and type checking the stubs
  rok
  committed
  26fa0e0
- Add _compute.pyi and reportMissingModuleSource
  
  AlenkaF
  authored and
  rok
  committed
  7d7a9fd
- Fix linter error
  
  AlenkaF
  authored and
  rok
  committed
  12ea05f
- Stubs ruff-format
  
  tadeja
  authored and
  rok
  committed
  25a866b
- Move to __lib/ to fix Module errors for pa.array/table/scalar
  
  tadeja
  authored and
  rok
  committed
  94021e0
- Move remaining ipc/types.pyi to __lib/
  
  tadeja
  authored and
  rok
  committed
  ae3cad1
- Review type.pyi
  
  AlenkaF
  authored and
  rok
  committed
  ca5eb2e
- Add typing_extensions to dependency-groups test
  
  tadeja
  authored and
  rok
  committed
  d18e949
- Array staticmethod _import_from_c_capsule/device and test
  
  tadeja
  authored and
  rok
  committed
  cf32c2e
- Add hash stubs to ExtensionType and KeyValueMetadata
  
  AlenkaF
  authored and
  rok
  committed
  516e8a9
- Simplified array inputs, ignore opt imports, fix DLPack signature and test
  
  tadeja
  authored and
  rok
  committed
  401c3c9
- Change Array.equals Any to Array and add tests
  
  tadeja
  authored and
  rok
  committed
  368a6dc
- Review table.pyi
  
  AlenkaF
  authored and
  rok
  committed
  91c3f0b
- Update ci/scripts/python_test_type_annotations.sh
  
  authored and
  rok
  committed
  1589c4c
- Remove sys.version_info >= (3, 11) check
  
  AlenkaF
  authored and
  rok
  committed
  f6892cd
- Assert struct array
  
  AlenkaF
  authored and
  rok
  committed
  a1163e2
- Add test for list_
  
  AlenkaF
  authored and
  rok
  committed
  e51b18e
- Fix CI ty check failure latest v0.99
  
  tadeja
  authored and
  rok
  committed
  d297339
- More cases for test_table.py
  
  tadeja
  authored and
  rok
  committed
  9dcdac6
- table.pyi: Allow array protocols for inputs. Specify append_column
  
  tadeja
  authored and
  rok
  committed
  2f49f15
- Update python/pyarrow-stubs/tests/test_types.py
  
  authored and
  rok
  committed
  3301e77
- Add test for Field.metadata
  
  AlenkaF
  authored and
  rok
  committed
  bf4a592
- Remove sys.version_info >= (3, 11) on all files
  
  AlenkaF
  authored and
  rok
  committed
  a9cdd20
- Update python/pyarrow-stubs/pyarrow/__lib/error.pyi
  
  authored and
  rok
  committed
  905aa33
- More cases for test_array.py
  
  tadeja
  authored and
  rok
  committed
  a94a96e
- Review array.pyi
  
  tadeja
  authored and
  rok
  committed
  319b5c5
- Apply AlenkaF's suggestions and add tests
  
  tadeja
  authored and
  rok
  committed
  b642a3b
- Apply batched suggestions from code review
  rok
  committed
  4b7dc90
- Move stubs to a flat pyarrow-stubs package and tests to pyarrow-stubs-tests
  rok
  committed
  41cc576
- Address review comments on type checking setup and stubs
  rok
  committed
  82f4e53
- Re-export annotated pyarrow.lib names in pyarrow and use pa.* in tests
  rok
  committed
  79a8f15
Commits on Nov 10, 2026
- Run the ruff hooks for the type stubs on commit
  rok
  committed
  046f15f
- Install the stub type checkers with uvx from requirements-stubs.txt
  rok
  committed
  5caf254
- Mark MonthDayNano as final in the type stubs
  rok
  committed
  c093920
- Remove the partial marker so that pyright checks the type stubs
  rok
  committed
  cce4648
- Remove the import ignores from the type stubs
  rok
  committed
  61c7c26
- Add tensor.pyi updates and tensor test file
  AlenkaF
  committed
  6ed844e
- Update stubtest allowlist
  AlenkaF
  committed
  6a4e614
- Update _KeyValueMetadataInput
  AlenkaF
  committed
  da3465a
- Update __contains__ and __getitem__ in KeyValueMetadata
  AlenkaF
  committed
  86fe422
- test_array.py unused type-ignore
  tadeja
  committed
  5ea9439
- Update mask arg in array()
  AlenkaF
  committed
  42927be
- Update Mask alias
  AlenkaF
  committed
  724d480
- Update python/pyarrow-stubs/__lib/array.pyi
  
  AlenkaF
  and
  jorisvandenbossche
  authored
  1335885
- pyarrow/tests/test_*.py remove/update ignores
  tadeja
  committed
  bb913a8
- Clean up the type stubs
  rok
  committed
  17e3a08
- Tidy the type checking setup
  rok
  committed
  e054197
- Remove the type checker accommodations from the PyArrow tests
  rok
  committed
  4be907a
- Import scipy directly in the tensor type stub test
  rok
  committed
  2d3f85c
- Fix the type stub mismatches that stubtest skipped
  rok
  committed
  6ae817e
- Make the optional import fallbacks in the PyArrow tests pass mypy
  rok
  committed
  ff91bcf
- Apply suggestion from @rok
  rok
  authored
  c7d1d97
- Order imports and unify importing from pyarrow.lib
  AlenkaF
  committed
  d027724
- Fix the CI due to changes in imports
  AlenkaF
  committed
  9fc46cd
- Update Indiced type alias
  AlenkaF
  committed
  a8cc1ae
- array.pyi: from_pandas type to accept str
  tadeja
  committed
  96ba7b9
- test_array.py: test from_pandas str and take Array indices
  tadeja
  committed
  0e446fc
- array.pyi: from_buffers accept Collection instead of Sequence
  tadeja
  committed
  faf04a9
- Use TYPE_CHECKING for invalid usage in stub tests and fix review findings
  rok
  committed
  4a899eb
- Fix type checker errors in stub tests
  rok
  committed
  91ae655
- array.pyi: nulls/repeat return Array instead of ArrayLike
  tadeja
  committed
  d2462bd

Commits

Commits on Nov 9, 2026

Commits on Nov 10, 2026