ControlNet v1.1 for Stable Diffusion 1.5 and 2.0
The models of Stable Diffusion 1.5 and Stable Diffusion 2.0 are compatible, which means that the model files of ControlNet v1.1 can also be used on Stable Diffusion 2.0.
This article is a compilation of different types of ControlNet models that support SD1.5 / 2.0, organized by ComfyUI-WIKI.
ControlNet v1.1
Large Size from lllyasviel
Provider: lllyasviel
GitHub Repository:https://github.com/lllyasviel/ControlNet-v1-1-nightly (opens in a new tab)
Hugging Face Repository:https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main (opens in a new tab)
Compatible Stable Diffusion Versions: stable diffusion v1.5,2.0
Size: 1.45 GB
File Name | Size | Update TIme | Note | Download Links |
---|---|---|---|---|
control_v11e_sd15_ip2p.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11e_sd15_shuffle.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11f1e_sd15_tile.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11f1p_sd15_depth.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_canny.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_inpaint.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_lineart.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_mlsd.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_normalbae.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_openpose.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_scribble.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_seg.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15_softedge.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) | |
control_v11p_sd15s2_lineart_anime.pth | 1.45 GB | May 2023 | Download Link (opens in a new tab) |
Medium - Safetensors/FP16 中等体积,来自 comfyanonymous 提供的版本
Provider:comfyanonymous Hugging Face Repository:https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main (opens in a new tab) Size: 723MB Note: Provided by the ComfyUI author's Hugging Face repository, it offers a better user experience in ComfyUI and is also compatible with other UIs.
File Name | Size | Update Time | Download Links |
---|---|---|---|
control_v11e_sd15_ip2p_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11e_sd15_shuffle_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11f1e_sd15_tile_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11f1p_sd15_depth_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_canny_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_inpaint_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_lineart_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_mlsd_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_normalbae_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_openpose_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_scribble_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_seg_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15_softedge_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11p_sd15s2_lineart_anime_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
control_v11u_sd15_tile_fp16.safetensors | 723 MB | 2023年4月 | Download Link (opens in a new tab) |
Small - Control lora Safetensors/FP16 较小体积来自 comfyanonymous 提供的版本
Provider:comfyanonymous Hugging Face Repository:https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main (opens in a new tab) Size: 136MB Note: Provided by the ComfyUI author's Hugging Face repository, it offers a better user experience in ComfyUI and is also compatible with other UIs.
File Name | Size | Update Time | Download Links |
---|---|---|---|
control_lora_rank128_v11e_sd15_ip2p_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11e_sd15_shuffle_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11f1e_sd15_tile_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11f1p_sd15_depth_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_canny_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_inpaint_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_lineart_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_mlsd_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_normalbae_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_openpose_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_scribble_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_seg_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15_softedge_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
control_lora_rank128_v11p_sd15s2_lineart_anime_fp16.safetensors | 136 MB | 2023年4月 | Download Link (opens in a new tab) |
ControlNet for StableDiffusion 2.1
Provider: thibaud
Hugging Face Repository:https://huggingface.co/thibaud/controlnet-sd21 (opens in a new tab)
The following file formats are divided into .safetensors
and .ckpt
. Generally, if you only intend to use the corresponding model, downloading the .safetensors
file will suffice.
File Name | Size | Update Time | Note | Download Link |
---|---|---|---|---|
control_v11p_sd21_ade20k.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_canny.ckpt | 9.59 GB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_canny.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_color.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_depth.ckpt | 9.59 GB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_depth.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_hed.ckpt | 9.59 GB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_hed.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_lineart.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_normalbae.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_openpose.ckpt | 9.59 GB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_openpose.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_openposev2.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_scribble.ckpt | 9.59 GB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_scribble.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) | |
control_v11p_sd21_zoedepth.safetensors | 728 MB | April 2023 | Download Link (opens in a new tab) |
How to Use ControlNet Model in ComfyUI
The usage of the ControlNet model is focused in the following article:
How to use ControlNet in ComfyUIIt will cover the following topics:
- How to install the ControlNet model in ComfyUI
- How to invoke the ControlNet model in ComfyUI
- ComfyUI ControlNet workflow and examples
- How to use multiple ControlNet models, etc.
Overview of ControlNet 1.1 Model
ControlNet 1.1 is an updated and optimized version based on ControlNet 1.0, with the same architecture. It includes all previous models and adds several new ones, bringing the total count to 14.
New Features and Improvements ControlNet 1.1 introduces several new features and improvements:
- New Soft Edges: A new soft edge processing method called "SoftEdge_safe" has been added to enhance the naturalness of image edges.
- Preprocessor Expansion: Multiple new preprocessors have been added, such as Canny, Depth, inpaint, etc., which can be used for various image processing tasks.
- Robustness and Quality Enhancement: The version mainly strengthens the model's robustness and the quality of the generated images.
Application Scenarios for ControlNet 1.1
ControlNet 1.1 can be applied to a variety of AI painting scenarios, including but not limited to:
Image Restoration: Utilize the inpaint preprocessor to fill and restore damaged or missing parts of an image. Edge Detection: Extract edge information from images using the Canny preprocessor for further application in other image processing tasks. Depth Map Generation: Generate depth information of images through the Depth preprocessor to create a more three-dimensional visual effect.