You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
for example, the code in " diffusers--examples--dreambooth--train_dreambooth_lora_qwen_image.py": lr_scheduler = get_scheduler()这里前后的代码,The official diffusers training template for Accelerate has a mistake in scheduler creation. This causes lr scheduler total steps / warmup steps to be N times larger than real global update steps, learning rate never decays normally. Also there is a ordering bug:
The script calculates training steps & creates lr_scheduler beforeaccelerator.prepare(train_dataloader).
At this point len(train_dataloader) is the non-distributed value (not sharded). After prepare, dataloader length changes, but scheduler has already been initialized with wrong step count.
This is a potential bug that is difficult to detect in schedule constant mode.
Reproduction
Use diffusers official training script + Accelerator
Activity
akhil9tiet commentedon Oct 20, 2026
I'd like to work on this — please assign it to me.
weixiaohao commentedon Oct 20, 2026
@sayakpaul
Thanks! I’ve outlined the root cause and fix steps in the issue. Looking forward to your PR.