Krea 2 Turbo SDA LoRA Restores Sampling Diversity

ComfyUI Wikinews

F16 releases a Krea 2 Turbo LoRA trained with Semantic Directional Alignment: the same prompt now yields different cats, cars and scenes across seeds, with no quality loss.

Krea 2 Turbo SDA Diversity LoRA v1.0 (Hugging Face) from F16 fixes a known trade-off of distilled fast models: Krea 2 Turbo regenerates nearly the same image from the same prompt across seeds. This rank-32 LoRA restores that seed diversity without hurting image quality or prompt adherence, measured with a +85% jump in pairwise CLIP distance at parity HPSv2.1 quality.

The cleanest illustration is 16 seeds of "a cat sitting on a windowsill". Baseline Turbo redraws the same tabby-and-white cat every time. With the LoRA active, seeds vary fur patterns, lighting, season and even window setting:

Baseline: 16 seeds, one catWith SDA LoRA: 16 seeds, 16 cats
Baseline Turbo: same cat 16 timesWith the SDA LoRA: varied fur, light and settings

The same pattern holds for still lifes (one pineapple template vs varied compositions) and portraits (identical studio headshot framing vs different ages, hair and scenes).

How SDA works

SDA principle diagram

Semantic Directional Alignment treats diversity collapse as a direction problem. For one training image, two random noises are drawn and noisified to sigma 0.9567, the highest learnable step of the 8-step Turbo schedule where composition is decided. The frozen teacher (Krea 2 RAW, the non-distilled parent) and the student (Turbo plus the LoRA) each predict what the image would be for both noises, and a frozen CLIP stack embeds the predictions. The teacher's change in perceptual direction records how a noise swap should move the image; the loss teaches the student's direction to match it instead of collapsing all noises onto one template. A best-of-5 candidate exploration adds roughly 3x learning speed on top.

Training used only 109 images at 1024x1024, which explains how a small adapter can shift composition without drifting style.

The gate matters: 2 steps, then off

The LoRA was trained at a single high-noise node, so it must only be active for the first 2 of the 8 denoise steps. The author's measurements:

Gate (active steps of 8)Result
1Works, but 20% less diversity
2Intended configuration, all numbers above
8 (always on)Quality collapse: noise or blur, -10% HPS

Stock ComfyUI applies LoRAs on every step, so a per-step LoRA scheduling node (hooks or scheduling custom nodes) is required to switch the adapter off after step 2. The repo also ships a ready-made workflow, Krea2_turbo_sda_workflow.json, built around the ClownsharKSampler Beta with the gating wired in.

Files

FileSizeUse
krea2_turbo_sda_v1.0_comfy.safetensors447 MBComfyUI key format
krea2_turbo_sda_v1.0_diffusers.safetensors447 MBdiffusers Krea2Pipeline

The diffusers pipeline snippet in the model card implements the gate as a one-line step callback. A Chinese model card is included in the repository.

Comments

Sign in with GitHub to join the discussion.

Loading comments…
Krea 2 Turbo SDA LoRA Restores Sampling Diversity | ComfyUI Wiki