Getting Started with LoRA in ComfyUI - From Basic Usage to Multiple Models

A comprehensive beginner's guide to using LoRA in ComfyUI, covering both basic single model usage and advanced multiple LoRA combinations to achieve richer AI art effects. Includes detailed instructions for model installation and parameter adjustments.

Using LoRA in ComfyUI

What is LoRA? In AI art generation, LoRA is a small, flexible model that you can think of as a "filter" that can give your images specific styles, content, and details:

  • Apply specific artistic styles (like ink painting)
  • Add characteristics of certain characters (like game characters)
  • Add specific details to the image All of these can be achieved through LoRA.

This tutorial provides a basic guide for using multiple LoRA models in ComfyUI, using the SD1.5 model. The core node is the LoRA Loader node, which is responsible for loading LoRA models.

Preparation

Step 1: Download the Models Used in This Tutorial

If you already have other relevant models on your computer, you can skip this step. If not, you can download the models used in this tutorial:

Model TypeModel NameDownload Link
SD1.5 ModelDreamShaper v8Download
LoRA ModelMoXinDownload
LoRA ModelQingYiDownload

In your ComfyUI directory, ensure you have the following folder structure:

📁ComfyUI
├── 📁models
│   ├── 📁checkpoints
│   │   └── 📁SD1.5              // Store DreamShaper v8
│   └── 📁loras
│       └── 📁SD1.5              // Store LoRA models
  1. Place the DreamShaper model in the models/checkpoints/SD1.5 folder
  2. Place the MoXin and QingYi LoRA files in the models/loras/SD1.5 folder
The reason for using the `SD1.5` subfolder in the corresponding model directory is that there are currently many different models like SD1.5, SD3.0, SDXL, FLUX, etc., and their model resources may not be universally compatible, so subfolders are needed for distinction. You can also rename the corresponding model files to add some simple model information descriptions, making it easier to distinguish when you have many models later.

Step 2: Restart ComfyUI

After installation, restart or refresh ComfyUI to let it recognize the new models

Step 3: Download and Import the Workflow File into ComfyUI

Workflow File Description

In this file, I provide three workflows:

  • Base model
  • Base model + MoXin LoRA (weight 1.0)
  • Base model + MoXin LoRA (weight 0.2) + QingYi LoRA (weight 0.1)

They all use the same seed to ensure consistent variables for comparing the effects before and after applying LoRA. You can try modifying different weights to compare the effects.

Related Content

ComfyUI LoRA Loader Node Documentation How to Install LoRA Models in ComfyUI