Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
ea57e3c
Protect sealed weight snapshots and daemon runtime ownership
whjthu Oct 26, 2026
63e7ea4
Bound IPC requests and cancel failed distributed reads
whjthu Oct 26, 2026
97335f6
Publish verified disk cache generations with lease-aware collection
whjthu Oct 26, 2026
8cca2e6
Enforce container memory limits and shared resident budgets
whjthu Oct 26, 2026
e2c2065
Add leased commands and cache lifecycle diagnostics
whjthu Oct 26, 2026
7454e9c
Document cache operations and add Linux regression CI
whjthu Oct 26, 2026
48615de
Add explicit tensor sharding with atomic streaming export
whjthu Oct 26, 2026
43d7a75
Share sealed CPU tensors with live topology slicing
whjthu Oct 26, 2026
70c0979
Validate distributed TP and PP execution after coordinated preload
whjthu Oct 26, 2026
895c5ef
Manage GPU expert residency with CPU fallback and safe eviction
whjthu Oct 26, 2026
33b176e
Document validated history and development priorities
whjthu Oct 26, 2026
8dc5f34
Close cached descriptors across interrupted and partial loads
whjthu Oct 26, 2026
2b6522d
Normalize runtime paths and reject invalid cache locations
whjthu Oct 26, 2026
5acb8b7
Publish runtime sockets safely and wait for cache shutdown
whjthu Oct 26, 2026
8fe11ec
Share strict safetensors validation across planning commands
whjthu Oct 26, 2026
da2efa2
Separate CLI arguments and derive completion from the parser
whjthu Oct 26, 2026
f6ba2e5
Clarify cache usage and archive historical development records
whjthu Oct 26, 2026
92afa75
Keep rank view metadata out of source file inventories
whjthu Oct 26, 2026
6693f9b
Recheck disk cache usage under the collection lease
whjthu Oct 26, 2026
9b0de02
Forward run cancellation and support explicit daemon sockets
whjthu Oct 26, 2026
d515001
Discount completed resident files from pending headroom reservations
whjthu Oct 26, 2026
5360338
Use one tensor layout contract for planning and runtime views
whjthu Oct 26, 2026
3bd87d5
Keep the latest expert completion event per consumer stream
whjthu Oct 26, 2026
4412029
Document lease transfer limits and remaining preparation costs
whjthu Oct 26, 2026
31fde8b
Preserve inherited ignored signals in foreground consumers
whjthu Oct 26, 2026
df177cf
Retain recovery state until runtime cleanup completes
whjthu Oct 26, 2026
ca908bb
Start daemon readiness waits after local cache preparation
whjthu Oct 26, 2026
146c256
Release private socket ownership after successful publication
whjthu Oct 27, 2026
8aabad2
Isolate default signal tests from inherited dispositions
whjthu Oct 27, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
name: Linux regression tests
on: [push, pull_request]
permissions:
contents: read
jobs:
tests:
runs-on: ubuntu-latest
timeout-minutes: 10
strategy:
fail-fast: false
matrix:
python: ['3.10', '3.11', '3.12', '3.13', '3.14']
steps:
- uses: actions/checkout@v7
with:
persist-credentials: false
- uses: actions/setup-python@v7
with:
python-version: ${{ matrix.python }}
- run: python -m pip install -e '.[test]'
- run: python -m pytest -q
- run: iloader selftest
- run: iloader doctor --json
torch-cpu:
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
- uses: actions/checkout@v7
with:
persist-credentials: false
- uses: actions/setup-python@v7
with:
python-version: '3.12'
- run: python -m pip install torch --index-url https://download.pytorch.org/whl/cpu
- run: python -m pip install -e '.[test]' safetensors numpy
- run: python -m pytest -q
- run: python examples/hybrid_moe.py --device cpu --output hybrid-cpu.json
49 changes: 49 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
# Contributing

Keep changes focused on the cache's file interface, correctness and usability.
Optional tensor/device integrations should remain separate from the standard-library
core. Include a regression that reproduces a behavior failure rather than testing
only the implementation's current structure.

## Core checks

Use Linux with Python 3.10+:

```bash
python3 -m pip install -e '.[test]'
python3 -m pytest -q
iloader selftest
iloader doctor
```

The file-cache tests intentionally use arbitrary file bytes; they test filesystem
and lifecycle behavior, not model semantics. Runtime tests use real subprocesses,
memfds and Unix sockets. Fault-injection tests use only their own temporary paths.

## Optional PyTorch checks

Install a PyTorch build appropriate for the target device, then:

```bash
python3 -m pip install -e '.[test]' safetensors numpy
python3 -m pytest -q
python3 examples/hybrid_moe.py --device cpu --output hybrid-cpu.json
```

The optional tests cover tensor views, real local Gloo TP/PP execution and a small
reference MoE. Device tests skip when no compatible GPU is available; a CPU pass
does not validate CUDA/ROCm execution. Remote/device measurements must state their
commit, hardware, software versions and actual commands separately.

## Review and documentation

- Run the checks relevant to changed behavior and include their actual output.
- Preserve ordinary files and unknown runtime resources when testing cleanup.
- Keep CLI help, completion and both READMEs consistent. Completion is generated
from the argument parser and has executable Bash tests.
- Document memory ownership and lifetime when changing descriptors, mappings,
leases or device copies.
- Performance claims need a named baseline, reproducible commands and repeated
measurements; file-read bandwidth is not engine-startup latency.
- Historical maintenance records belong in [the archive](docs/archive/README.md),
while current operational contracts belong in [operations](docs/operations.md).
Loading
Loading