Slow LoRA Loader with Block Weight

[ai-waifu-life]

Slow LoRA Loader with Block Weight

[ltdrdata]

I'll check this later.

[ai-waifu-life]

I'll check this later.

Just checking if you've had a sec to take a look. Lemme know if you need anything from my end!

[ltdrdata]

Is this issue also being reproduced in this workflow? In my tests, while there is a slowdown when model patches are applied block by block compared to the default LoRA, even this process is instantaneous, so it's not to the extent that it would be problematic.

[ai-waifu-life]

Is this issue also being reproduced in this workflow? In my tests, while there is a slowdown when model patches are applied block by block compared to the default LoRA, even this process is instantaneous, so it's not to the extent that it would be problematic.

I noticed that in that you have the seed set to fixed. If no changes are made to the LORA Loader at all, then it is quick after the first run. If I randomize the seed, like I always have, then it will treat it like a first process every time.

[ltdrdata]

Is this issue also being reproduced in this workflow? In my tests, while there is a slowdown when model patches are applied block by block compared to the default LoRA, even this process is instantaneous, so it's not to the extent that it would be problematic.

I noticed that in that you have the seed set to fixed. If no changes are made to the LORA Loader at all, then it is quick after the first run. If I randomize the seed, like I always have, then it will treat it like a first process every time.

It is correct to always re-execute when randomizing the seed. This is because the patch weights applied to the model change. That seed is a feature to randomize the 'r' when it is used in block weight.

[ai-waifu-life]

It is correct to always re-execute when randomizing the seed. This is because the patch weights applied to the model change. That seed is a feature to randomize the 'r' when it is used in block weight.

Oh! Wait, so that could mean my workflow wasn't working correctly previously? 😂 Well that's great to know lol.
Appreciate your time on this!