[LoRA] feat: support unload_lora_weights() for Flux Control. by sayakpaul · Pull Request #10206 · huggingface/diffusers (original) (raw)

@a-r-r-o-w thanks for flagging the device assignment while initializing original_module. device takes priority so original_module was not getting initialized on "meta", rending the previous copy_() ops ineffective.

LMK what you think about the current changes (have run the corresponding tests on a GPU and they pass).

@DN6 LMK your comments here too.