Commit f9dbd8d
fix: re-apply explicit d_kv passthrough (regressed in the resumability commits)
ByT5 keeps d_kv=64 at any width; the d_model/heads derivation built
inner dims of 1470 for the layerdrop student and crashed the bridge.1 parent d0f2d9d commit f9dbd8d
1 file changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
659 | 659 | | |
660 | 660 | | |
661 | 661 | | |
662 | | - | |
| 662 | + | |
663 | 663 | | |
664 | 664 | | |
665 | 665 | | |
| |||
1217 | 1217 | | |
1218 | 1218 | | |
1219 | 1219 | | |
1220 | | - | |
| 1220 | + | |
1221 | 1221 | | |
1222 | 1222 | | |
1223 | 1223 | | |
| |||
0 commit comments