Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -298,6 +298,17 @@ byte-identical opaque pages. Restore reconstructs and verifies the complete
snapshot before Python or native page placement. Arbitrary earlier-prefix
aliases cannot be derived from opaque page snapshots.

Page-delta publication writes `sparkcache-page-delta-manifest/v2` metadata over
authenticated byte extents of at most 64 MiB. This physical grouping reduces
the 1,024 delta files implied by a 262,144-token logical boundary to at most 24
objects for a 1,575,821,491-byte delta. Reads retain at most four extent
payloads in addition to one assembled delta buffer. The logical admission and
digest boundary remains 256 tokens. Version 1 page-delta manifests remain
readable; cache identity, digest salts, and the `page-tail-cow-v1` namespace do
not change. Restore still materializes one authenticated delta buffer and the
verified reconstructed snapshot before placement. Direct placement from base
and delta extents is unsupported by this schema.

Opaque HMA snapshots cannot be shortened by truncating chunk lists. SparkCache
therefore uses the page-semantic format and distinct namespace described above.
At most two page deltas may form one graph; the following publication compacts
Expand Down
2 changes: 1 addition & 1 deletion deploy/deepseek_v4/tp4_profile.json
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cache_model_profile": "deepseek-v4-fp8-hma",
"published_runtime_base": "ghcr.io/fujitsupolycom/gb10-vllm-serving@sha256:6fc26fdad81a18f0fff67ce0a05f6d90165625ea2e1cac8a6f39bfb462017028",
"sparkcache": {
"source_sha256": "bc238f96e550c7ec27d4081dd1f2e741d404aaf5c8572d89ccc5e76812be4d63"
"source_sha256": "9b8b2a6863d91f07354dab67d608cc15f551f1a5a7682b89873c7ae6ba468ee5"
},
"model": {
"repository": "deepseek-ai/DeepSeek-V4-Flash-0731",
Expand Down
2 changes: 1 addition & 1 deletion deploy/glm52_35bpw/profile.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"published_runtime_base": "ghcr.io/fujitsupolycom/gb10-vllm-serving@sha256:6fc26fdad81a18f0fff67ce0a05f6d90165625ea2e1cac8a6f39bfb462017028",
"base_image_requirement": "exact GLM-5.2 3.5-bpw R7 image recorded by the source container inspection",
"sparkcache": {
"source_sha256": "bc238f96e550c7ec27d4081dd1f2e741d404aaf5c8572d89ccc5e76812be4d63"
"source_sha256": "9b8b2a6863d91f07354dab67d608cc15f551f1a5a7682b89873c7ae6ba468ee5"
},
"model": {
"repository": "brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78",
Expand Down
19 changes: 13 additions & 6 deletions sparkcache/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -226,12 +226,19 @@ when placement completes and intentionally excludes that bookkeeping.
prefixes and binds the base snapshot, layout, block counts, and semantic
token boundaries. A boundary inside an HMA page replaces that complete page
while retaining earlier byte-identical pages. The
`sparkcache-page-delta-manifest/v1` schema embeds its authenticated base
graph, allowing capacity maintenance to retain shared objects after
predecessor roots are removed. Restore reconstructs the verified full
snapshot before Python or native page placement. GPU-free regression coverage
exists; live model-serving qualification does not. A graph contains at most
two deltas. The following extension publishes a fresh flat snapshot, bounding
`sparkcache-page-delta-manifest/v2` schema embeds its authenticated base
graph and groups delta bytes into immutable objects of at most 64 MiB. A
1,575,821,491-byte delta therefore uses at most 24 physical delta objects
instead of 1,024 objects derived from logical token chunks. Ordered restore
batches retain at most four object payloads in addition to one assembled
delta buffer. Version 1 manifests remain readable. Cache identity, digest
salts, the 256-token logical boundary, and the `page-tail-cow-v1` namespace
are unchanged. Capacity maintenance retains shared objects after predecessor
roots are removed. Restore reconstructs the verified full snapshot before
Python or native page placement. GPU-free regression coverage exists; live
model-serving qualification does not. Direct placement from base and delta
extents is unsupported by this schema. A graph contains at most two deltas.
The following extension publishes a fresh flat snapshot, bounding
reconstruction work and metadata ancestry.
- **Concurrent shared GPU prefix — implemented.** One leader restores a
persistent digest. After every rank succeeds, up to sixteen waiting followers
Expand Down
Loading