Unsloth MiniMax H3 GGUF Quants: Full Q2-Q8 Range for Local Use

ComfyUI Wikinews

Unsloth publishes MiniMax H3 GGUF quants from Q2_K (6.3 GB) to Q8_0 (20 GB) for FL2VA and Ref2VA plus Qwen3-VL text encoder GGUFs for ComfyUI and stablediffusion.cpp.

Unsloth published GGUF quantizations of MiniMax H3 on August 10, covering the full Q2:Q8 range for both H3 denoisers plus the Qwen3-VL text encoder they need. The files are compatible with ComfyUI, stablediffusion.cpp and Unsloth, giving low-VRAM users a much wider ladder of options than the initial community quant wave.

MiniMax H3 GGUF demo clip generated at UD-Q2_K_XL

Demo clip generated with the smallest rung, UD-Q2_K_XL: 960x544, 124 frames, 24 FPS, 8 steps, guidance 1.0 (GIF downsampled and silent; the full MP4 carries H3's native 32 kHz stereo audio)

What shipped

H3 ships two denoisers, and both are quantized at the same rungs:

QuantFL2VA prunedRef2VA pruned
Q2_K6.26 GiB6.22 GiB
UD-Q2_K_XL7.51 GiB
Q3_K8.16 GiB8.12 GiB
UD-Q3_K_XL8.90 GiB
Q4_K10.64 GiB10.60 GiB
Q5_012.97 GiB12.93 GiB
Q6_K15.45 GiB15.42 GiB
Q8_019.96 GiB19.94 GiB

FL2VA is the first-and-last-frame variant (text plus zero, one or two frames); Ref2VA is the reference variant (text plus reference pictures, videos and audio). They are separate checkpoints, so pick the one that matches the task.

The Qwen3-VL 32B text encoder that H3 needs is also available as GGUF: qwen3vl_32b_minimax_h3-Q2_K_M.gguf (12.20 GiB) and qwen3vl_32b_minimax_h3-Q4_K_M.gguf (16.97 GiB).

Which file fits your GPU

VRAMRecommended rung
8–12 GBQ2_K or UD-Q2_K_XL
12–16 GBQ3_K / UD-Q3_K_XL or Q4_K
16–24 GBQ5_0 or Q6_K
24 GB+Q8_0

For reference, the demo above ran on a single card at 960x544 with the UD-Q2_K_XL rung.

How to use it in ComfyUI

The diffusion-model GGUFs load through the standard ComfyUI GGUF loader nodes (ComfyUI-GGUF), the same way as the earlier community H3 quants, and the text encoder GGUF goes through the GGUF text-encoder loader. Pair the file with the MiniMax H3 video and audio VAEs as usual.

Availability

All files are on Hugging Face at unsloth/MiniMax-H3-GGUF. Besides ComfyUI, the same files run through stablediffusion.cpp and Unsloth's own runtime.

Comments

Sign in with GitHub to join the discussion.

Loading comments…
Unsloth MiniMax H3 GGUF Quants: Full Q2-Q8 Range for Local Use | ComfyUI Wiki