Skip to content

Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3 - #44

Merged
Uxito-Ada merged 2 commits into
Tele-AI:mainfrom
Uxito-Ada:feat/minimax-h3-lora-adapters
Sep 7, 2026
Merged

Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3#44
Uxito-Ada merged 2 commits into
Tele-AI:mainfrom
Uxito-Ada:feat/minimax-h3-lora-adapters

Conversation

@Uxito-Ada

@Uxito-Ada Uxito-Ada commented Sep 2, 2026

Copy link
Copy Markdown
Collaborator

Summary

Enable Minimax-H3 LoRA adapter, and support the adapter to run with TeleFuser FP8 Linear

Supported adapter:

  • MiniMax-H3 Turbo LoRA
  • FastVideo fastvideo-lora-v2 to merge with dense FastH3, a FastVideo-finetuned H3

Adapter updates are merged into the BF16 base weights before optional FP8 conversion, so the FP8 quantizes the final adapted weights

Changes

  • Detect fastvideo-lora-v2 metadata and apply W += B @ A without an implicit alpha/rank scale
  • Stream and merge low-rank tensors plus exact .diff, .diff_b, and .diff_m residuals in float32
  • Expose --adapter-path / --lora-path and --adapter-strength through the standard MiniMax H3 FL2VA H100 example
  • Document BF16 adapter and FP8 Linear + adapter usage

Performance

Matched workload:

  • 1 * H100 80GB
  • 1344 x 768
  • 124 frames
  • 5.175 seconds
  • Minimax-H3 Turbo LoRA, and FastH3 adapter

Minimax-H3 Turbo LoRA, compared with the only one community solution on LightX2V:
minimax_h3_turbo_performance

Compared with LightX2V, TeleFuser improves denoising time by 26.7% and throughput by 36.5%.

FastH3 adapter, compared with FastVideo:
fasth3_performance

Compared with LightX2V, TeleFuser improves denoising time by 36.4% and throughput by 57.2%.

In addition, it is seen that FP8 does not shrink peak GPU memory so much, which is because that both LightX2V and FastVideo applies CPU offloading, whose whole weights size is actually double of the FP8 runtime. Their CPU offloading is at the cost of high latency.

Generated Output Comparison

All three outputs contain 124 H.264 frames at 1344 x 768 and synchronized stereo AAC audio.

minimax_h3_lora_adapter_quality
Adapter Framework Video
MiniMax-H3 Turbo LoRA LightX2V BF16 + Sol
turbo_lightx2v_bf16_sol_resident_dit.mp4
MiniMax-H3 Turbo LoRA TeleFuser FP8 + Sol
turbo_telefuser_fp8_sol_best.mp4
FastH3 adapter FastVideo BF16 + FA4
fasth3_all_run_03.mp4
FastH3 adapter TeleFuser FP8 + Sol
fasth3_telefuser_fp8_sol_best.mp4

Testing

  • 149 passed: generic LoRA loader, MiniMax H3 model, pipeline, scheduler, parallelism, example, and adapter tests.
  • Added hybrid low-rank plus exact-delta merge coverage.
  • Added VSA replacement-gate rejection coverage.
  • Added adapter CLI forwarding and adapter-before-FP8 ordering coverage.
  • Ruff check and format check pass for all modified Python files.
  • git diff --check passes.
  • Verified the released dense-datafree safetensors header and tensor inventory with this branch.
  • Verified the three representative MP4s for codec, resolution, frame count, duration, and audio stream.

@Uxito-Ada Uxito-Ada changed the title feat(minimax-h3): support LoRA and FP8 adapters Feat: Support LoRA and FP8 adapter of Minimax-H3 Sep 2, 2026
@Uxito-Ada Uxito-Ada changed the title Feat: Support LoRA and FP8 adapter of Minimax-H3 Feat: Support LoRA and FP8 Adapter of Minimax-H3 Sep 2, 2026
@Uxito-Ada Uxito-Ada changed the title Feat: Support LoRA and FP8 Adapter of Minimax-H3 Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3 Sep 2, 2026
@Uxito-Ada
Uxito-Ada marked this pull request as draft September 2, 2026 02:35
@Uxito-Ada
Uxito-Ada marked this pull request as ready for review September 3, 2026 02:53
@Uxito-Ada
Uxito-Ada requested a review from lzx1413 September 3, 2026 02:53
Add FastVideo fastvideo-lora-v2 mappings for low-rank updates and exact weight or bias deltas while preserving the released Turbo LoRA alpha contract.

Merge adapters into source weights before optional online FP8 conversion, reject unsupported VSA replacement gates, and expose adapter options through the standard FL2VA example.

Document BF16 and FP8 usage and cover hybrid merging, VSA rejection, CLI forwarding, and adapter-before-quantization ordering.
@Uxito-Ada
Uxito-Ada force-pushed the feat/minimax-h3-lora-adapters branch from 30b0312 to 51d0fa5 Compare September 7, 2026 04:16
@Uxito-Ada
Uxito-Ada merged commit 015a5c7 into Tele-AI:main Sep 7, 2026
7 checks passed
@Uxito-Ada
Uxito-Ada deleted the feat/minimax-h3-lora-adapters branch September 7, 2026 05:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant