fix(download): include required root-level files without a metadata extension - #918
Conversation
…xtension ModelHub.repoIncludeRule builds one pattern per required model with a trailing "/" (bundle directories). For repos without a subPath, a required plain file was only admitted by prefix match or by the .json/.txt allowance, so a required root file such as `tokenizer.model` never matched "tokenizer.model/" and the post-download verify pass threw modelNotFound. Accept a pattern that equals the file path plus "/". Regression test added. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_018UHoFANi4DcvU6TzyTPnHH
… 48 kHz stereo Swift host for the CoreML conversion of OpenMOSS-Team/MOSS-TTS-Nano-100M (FluidInference/moss-tts-nano-coreml): Prefill -> (Frame -> CodecStep -> Step) per 80 ms frame, sampling inside the Frame graph from host uniforms. - MossTtsNanoTokenizer: SentencePiece BPE with nmt_nfkc normalization, dummy prefix and byte fallback; id-exact against the upstream processor on 8 vectors (English, Chinese, Japanese, Russian, emoji, whitespace edge cases). The PocketTTS SentencePieceTokenizer is unigram and cannot serve this model. - MossTtsNanoTextChunker: upstream sentence/clause/token-budget splitter and inter-chunk pauses. MossTtsNanoPromptBuilder: voice-clone row layout from the repo's config.json (template ids, special tokens). - MossTtsNanoManager: preset voices (en_2, zh_1), cloneVoice(audioURL:) via the fp32 codec encoder, synthesize / synthesizeStreaming (AsyncThrowingStream of stereo frames), seedable sampling. - Prefill/Step pinned to CPU+GPU (ANECCompile fails); Frame/CodecStep honour the requested compute units. - CLI: --backend moss-tts-nano with --voice/--clone-voice/--save-voice/ --voice-file/--seed/--greedy/--tokens-only; stereo WAV writer. - SentencePieceProto: parse the piece `type` field. - Docs: Documentation/TTS/MossTtsNano.md, Documentation/Models.md rows. Depends on the ModelHub root-file include fix (#918): tokenizer.model is a required root-level file. Measured (M5 Pro, release CLI, en_2 voice, 9-10 s utterances): RTFx 3.1-3.8x, first audio 0.22-0.40 s; zh_1 3 s utterance 2.5x. Parakeet WER 0 % on the 27-word phrase, one spurious trailing word on the short one. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_018UHoFANi4DcvU6TzyTPnHH
PocketTTS Smoke Test ✅
Runtime: 0m18s Note: PocketTTS uses CoreML MLState (macOS 15) KV cache + Mimi streaming state. CI VM lacks physical GPU — audio quality and performance may differ from Apple Silicon. |
Parakeet EOU Benchmark Results ✅Status: Benchmark passed Performance Metrics
Streaming Metrics
Test runtime: 1m10s • 09/13/2026, 08:02 PM EST RTFx = Real-Time Factor (higher is better) • Processing includes: Model inference, audio preprocessing, state management, and file I/O |
VAD Benchmark ResultsPerformance Comparison
Dataset Details
✅: Average F1-Score above 70% |
ASR Benchmark Results ✅Status: All benchmarks passed Parakeet v3 (multilingual)
Parakeet v2 (English-optimized)
Streaming (v3)
Streaming (v2)
Streaming tests use 5 files with 0.5s chunks to simulate real-time audio streaming 25 files per dataset • Test runtime: 6m31s • 09/13/2026, 08:10 PM EST RTFx = Real-Time Factor (higher is better) • Calculated as: Total audio duration ÷ Total processing time Expected RTFx Performance on Physical M1 Hardware:• M1 Mac: ~28x (clean), ~25x (other) Testing methodology follows HuggingFace Open ASR Leaderboard |
Supertonic3 Smoke Test ✅
Runtime: 0m25s Note: CI VMs lack a physical Neural Engine; the ANE-bucketed VectorEstimator falls back to CPU here. This validates download + variant resolution + synthesis, not ANE residency/perf. |
Sortformer High-Latency Benchmark ResultsES2004a Performance (30.4s latency config)
Sortformer High-Latency • ES2004a • Runtime: 2m 36s • 2026-09-14T00:18:22.082Z |
Offline VBx Pipeline ResultsSpeaker Diarization Performance (VBx Batch Mode)Optimal clustering with Hungarian algorithm for maximum accuracy
Offline VBx Pipeline Timing BreakdownTime spent in each stage of batch diarization
Speaker Diarization Research ComparisonOffline VBx achieves competitive accuracy with batch processing
Pipeline Details:
🎯 Offline VBx Test • AMI Corpus ES2004a • 1049.0s meeting audio • 118.8s processing • Test runtime: 2m 10s • 09/13/2026, 08:20 PM EST |
Speaker Diarization Benchmark ResultsSpeaker Diarization PerformanceEvaluating "who spoke when" detection accuracy
Diarization Pipeline Timing BreakdownTime spent in each stage of speaker diarization
Speaker Diarization Research ComparisonResearch baselines typically achieve 18-30% DER on standard datasets
Note: RTFx shown above is from GitHub Actions runner. On Apple Silicon with ANE:
🎯 Speaker Diarization Test • AMI Corpus ES2004a • 1049.0s meeting audio • 40.2s diarization time • Test runtime: 2m 57s • 09/13/2026, 08:27 PM EST |
Summary
ModelHub.repoIncludeRulebuilds one pattern per required model with a trailing/(bundle directories). For repos without asubPath, a required plain file was admitted only by prefix match or by the.json/.txtallowance, so a required root-level file such astokenizer.modelnever matchedtokenizer.model/and the post-download verify pass threwmodelNotFound(every run re-listed the repo and failed again).The rule now also accepts a pattern that equals the file path plus
/. No change for subPath repos or for bundle directories.Test
ModelHubIncludeRuleTests.testRequiredRootFileWithoutMetadataExtensionIncludedcovers the required file, an unrelated.modelfile, and bundle paths.🤖 Generated with Claude Code
https://claude.ai/code/session_018UHoFANi4DcvU6TzyTPnHH