How to Install and Use LoRA Models in ComfyUI?
The Principle of LoRA Models
Imagine you have a versatile robot chef that can make various basic dishes. However, if you want this robot chef to create some special dishes with specific flavors, like Italian pizza or Chinese dumplings, you need to provide it with some additional “recipes.”
- Stable Diffusion Stable Diffusion is like this versatile robot chef, capable of creating a variety of dishes (images) based on different ingredients (descriptions). It excels at understanding your requests and creating delicious dishes that match your descriptions.
- LoRA Models LoRA models are like the extra “recipes” provided to this robot chef. These “recipes” help the robot chef learn to make some special dishes, enriching its cooking skills.
Principle
- Basic Ability: The robot chef (Stable Diffusion) already knows how to make various basic dishes.
- Special Recipes: LoRA are those special “recipes” that teach the chef how to make dishes with specific flavors.
- Learning Process: By learning these “recipes,” the robot chef can gradually master the skills to make these special dishes.
Function
- Personalization: Using LoRA, the robot chef can create more personalized dishes to meet your specific flavor needs.
- Flexibility: Even after learning new “recipes,” the robot chef can still make any other dishes, becoming more versatile.
- Efficiency: LoRA allows the robot chef to learn new “recipes” without forgetting its original cooking skills, enabling it to quickly make the dishes you want.
LoRA models in Stable Diffusion are like a set of special “recipes” provided to the robot chef, allowing it to create the dishes you want more flexibly and personally while maintaining its original cooking abilities.
Where to Download LoRA Models?
Most AI drawing communities offer model downloads. You can quickly find this type of model by filtering for LoRA on the respective websites.
- civitai: https://civitai.com
- liblib (China): https://www.liblib.art/
As shown in the image below, select LoRA when filtering models on civitai to filter out LoRA models.
How to Install LoRA Models in ComfyUI?
Place the downloaded models in the “ComfyUI\models\loras” directory, then restart or refresh the ComfyUI interface to load the corresponding LoRA models.
Since models need to be versioned, for your convenience, I suggest renaming the model files with a version prefix like “SD1.5-ModelName,” or without renaming, create a new folder in the corresponding model directory named after the large model version like “SD1.5,” and then copy your model files into “ComfyUI\models\loras\SD1.5.”
If you are sharing model files with other GUIs, please refer to the shared model section in install comfyui and copy the corresponding model files to the appropriate folder.
How to Use LoRA Models in ComfyUI?
Please refer to the examples in the links below to use LoRA models.
Recommended LoRA Models
I have updated some LoRA recommendations on the page below, which you can download according to your needs.