Repository navigation
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
janickm
added this pull request to stack #201
October 14, 2026 07:28
Collaborator
Author
|
/ok to test 2bf2534 |
janickm
marked this pull request as ready for review
October 14, 2026 07:43
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 14, 2026 07:45
2bf2534 to
279593b
Compare
janickm
changed the title
Collaborator
Author
|
/ok to test 279593b |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
2 times, most recently
from
October 14, 2026 10:02
56ad15c to
b33ba3b
Compare
Collaborator
Author
|
/ok to test b33ba3b |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
2 times, most recently
from
October 14, 2026 10:09
77b8da2 to
9613402
Compare
Collaborator
Author
|
/ok to test 9613402 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 15, 2026 13:58
9613402 to
dd1c1cd
Compare
Collaborator
Author
|
/ok to test dd1c1cd |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 15, 2026 14:33
dd1c1cd to
5ccf35e
Compare
Collaborator
Author
|
/ok to test 5ccf35e |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 15, 2026 18:04
5ccf35e to
2d96893
Compare
Collaborator
Author
|
/ok to test 2d96893 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 16, 2026 13:23
2d96893 to
7a10d69
Compare
Collaborator
Author
|
/ok to test 7a10d69 |
janickm
changed the title
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 16, 2026 13:37
7a10d69 to
c490040
Compare
Collaborator
Author
|
/ok to test c490040 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 19, 2026 08:56
c490040 to
b114832
Compare
Collaborator
Author
|
/ok to test b114832 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 19, 2026 11:52
b114832 to
fbab0ff
Compare
Collaborator
Author
|
/ok to test fbab0ff |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 19, 2026 11:58
fbab0ff to
e880c2f
Compare
Collaborator
Author
|
/ok to test e880c2f |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 21, 2026 08:37
e880c2f to
ed41973
Compare
Collaborator
Author
|
/ok to test ed41973 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 21, 2026 08:53
ed41973 to
e7ce191
Compare
Collaborator
Author
|
/ok to test e7ce191 |
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 21, 2026 09:11
e7ce191 to
eacc8fa
Compare
…thon Separate the record storage of indexed tar archives (itar.py) from zarr-python, in preparation of supporting multiple zarr-python versions: - IndexedTarArchive provides raw access to the records of an archive: read() reads a record synchronously (also via the mapping interface, archive[key]), stores.ZarrIndexedTarStore adapts the archive to zarr-python's store interface; archives are context managers (closing them on exit, typed to return the archive, also of subclasses) - Read local archives via positional reads (os.pread), which don't serialize reads of multiple threads, and close their file descriptors also when archives are dropped without closing them - Serve records starting within the index tail read, and empty records, from memory - Look up the record index decoder / encoder by index type, and share the CBOR + LZMA document encoding of the record index and the compressed consolidated metadata (encoding.py) Archives are byte-identical to archives written by ncore 19.8 (tested via the sha256 of a fixed hierarchy written by ncore 19.8). BREAKING CHANGE: IndexedTarArchive (formerly stores.IndexedTarStore) is no longer a zarr-python store, wrap it via stores.ZarrIndexedTarStore to access zarr hierarchies of archives directly with zarr-python.
janickm
force-pushed
the
stack/zarr3/01-itar
branch
from
October 21, 2026 14:15
eacc8fa to
76cad78
Compare
Collaborator
Author
|
/ok to test 76cad78 |
1 similar comment
Collaborator
Author
|
/ok to test 76cad78 |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Separate the record storage of indexed tar archives (itar.py) from zarr-python, in preparation of supporting multiple zarr-python versions:
Archives are byte-identical to archives written by ncore 19.8 (tested via the sha256 of a fixed hierarchy written by ncore 19.8).
BREAKING CHANGE: IndexedTarArchive is no longer a zarr-python store, wrap it via stores.ZarrIndexedTarStore to access zarr hierarchies of archives directly with zarr-python.