H3 Acceleration Arena: Blind-Test Ranking of MiniMax H3 Speedups

The H3 Acceleration Arena runs blind A/B votes between pre-generated clips from different MiniMax H3 acceleration variants.

One arena for every H3 speedup

The MiniMax H3 acceleration scene has exploded over the past month: distillation LoRAs, merges, cache nodes and attention kernels now compete for attention, and most claims rest on self-reported benchmarks. The H3 Acceleration Arena, built by Hugging Face's multimodalart together with community benchmarkers, replaces those claims with blind pairwise votes. Two clips generated from the same prompt and seed with different acceleration variants play side by side, the viewer picks the better one, and Elo plus Bradley-Terry ratings accumulate into a public leaderboard with confidence intervals.

The current corpus covers 23 rated variants over a 200-prompt set with about 4,000 pre-generated clips, split across four slices: text-to-video visual, text-to-video audio, image-to-video visual and image-to-video audio. Because H3 generates audio jointly with video, the arena scores sound quality separately instead of letting a fast visual model win on pictures alone.

Which variants are in the pool

The rating pool spans most of the approaches we have covered individually:

Many of these are community LoRAs that had never faced each other on identical prompts, so the arena is the first apples-to-apples comparison for the H3 speedup ecosystem.

Not everything survives quality control

The arena's methodology is unusually strict about broken variants. Fifteen legs were withdrawn from voting with published reasons, including FastVideo full checkpoints whose VSA gate tensors are silently dropped by the diffusers loader (producing "blurred mush" that would have unfairly punished the authors), a Silveroxides merge traced to a confirmed upstream defect, and LightX2V SLA runs superseded by corrected re-runs. FastVideo's most-trained synthetic-data leg was parked purely to speed up rating convergence, not because it is broken.

Vote integrity gets similar care: sign-in is required through Hugging Face OAuth, each vote is attributed to a stable user ID, and clips are served under opaque tokens so variant names never leak before a vote is cast. Elo is anchored to the 28-step baseline at 1000 and confidence intervals come from bootstrap resampling plus order reshuffling, since the authors found that naive permutation intervals get narrower exactly when the data is thinnest.

Status

The leaderboard numbers are currently hidden until the Space's visibility is flipped public, but the arena app itself is live and running: its stats endpoint reports 200 pairable prompts, 23 pairable variants and a corpus of 4,000 clips, and the voting API responds. The Reddit post that announced it frames the project as "15+ H3 LoRAs, fine-tunes, Max" going head to head, and the announcement landed at the top of r/StableDiffusion and r/comfyui the same day. Once ratings go public, this will be the reference table for choosing which H3 acceleration to install, and it should also settle which of the many Turbo LoRA checkpoints is worth keeping.