Skip to content

Bound memory used by parallel S3 downloads - #44

Merged
joshfriend merged 1 commit into
mainfrom
jfriend/bounded-s3-download
Oct 20, 2026
Merged

joshfriend merged 1 commit into
mainfrom
jfriend/bounded-s3-download

Conversation

@joshfriend

Copy link
Copy Markdown
Collaborator

Bound S3 download buffering so slow extraction no longer queues most of a cache bundle in memory. Keep the existing request concurrency and range size.

Signed-off-by: Josh Friend <josh@fueledbycaffeine.com>
@joshfriend
joshfriend merged commit f703e23 into main Oct 20, 2026
8 of 9 checks passed
@joshfriend
joshfriend deleted the jfriend/bounded-s3-download branch October 20, 2026 20:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant