ComfyUI ecosystem updates — open-source model releases, custom nodes, workflows, and tools for image, video, and audio generation.
Researchers have proposed a new video relighting method, Light-A-Video, which achieves temporally smooth video relighting effects through Consistent Light Attention (CLA) and Progressive Light Fusion (PLF).
Open-Weights
StepFun has released the open-source text-to-video model Step-Video-T2V, which has 300 billion parameters, supports the generation of high-quality videos up to 204 frames, and provides an online experience platform
Open-Weights
Image to 3DKuaishou officially releases CineMaster text-to-video generation framework, enabling high-quality video content creation through 3D-aware technology
Open-Weights
Alibaba's latest open-source project InspireMusic, a unified audio generation framework based on FunAudioLLM, supporting music creation, song generation and various audio synthesis tasks.
Open-Weights
Text to imageAlibaba Research Institute open sources image generation tool ACE++, supporting character-consistent image generation from single input through context-aware content filling technology, offering online experience and three specialized models.
Open-Weights
ByteDance research team releases OmniHuman-1 human animation framework, capable of generating high-quality human video animations from a single image and motion signals.
Open-Weights
MultimodalDeepSeek open-sources Janus-Pro-7B, a multimodal AI model for image understanding and generation. Learn how to use it in ComfyUI.
Open-Weights
Image to 3DTencent releases Hunyuan3D 2.0, open-sourcing the complete DiT model and launching a one-stop 3D creation engine with innovative features including skeletal animation and sketch-to-3D, revolutionizing metaverse and game content creation
Open-Weights
ComfyUI celebrates its second birthday, evolving from a personal project into the world's most popular generative AI visual tool. Happy birthday, ComfyUI!
MIT
NVIDIA releases new Sana model capable of quickly generating images up to 4K resolution on consumer laptop GPUs, with ComfyUI integration support
Open-Weights
ByteDance releases open-source lip sync tool LatentSync, based on audio-conditioned latent space diffusion model, enabling precise lip synchronization for both real people and animated characters while solving frame jittering issues common in traditional methods
Open-Weights
Text to imageByteDance and University of Science and Technology of China jointly launch VMix adapter, enhancing AI-generated image aesthetics through cross-attention mixing control technology, seamlessly integrating with existing models without retraining
Open-Weights
Image to 3DStereoCrafter, jointly developed by Tencent AI Lab and ARC Lab, is now open source. It can convert any 2D video into high-quality stereoscopic 3D video, supporting various 3D display devices including Apple Vision Pro
Open-Weights
Image editinglllyasviel, creator of ControlNet and IC-Light, releases LuminaBrush - a new AI tool that enables precise lighting control through a two-stage framework with intuitive brush interactions
Open-Weights
Genesis project releases a new universal physics engine and generative AI platform, integrating physics simulation, robot control and generative AI capabilities to provide comprehensive solutions for robotics and physical AI applications
Open-Weights
Odyssey launches Explorer, the first generative world model that can convert 2D images into complete 3D worlds, supporting dynamic effects and mainstream creative tool editing, bringing revolutionary changes to film, gaming and other fields
Open-Weights
Text to imagePopular ComfyUI plugin Impact-Pack discovered to contain mining malware through Ultralytics package, affecting numerous users. This article details the virus situation and solutions.
Open-Weights
Text to imageLuma introduces revolutionary Photon and Photon Flash image generation models, redefining AI creation with outstanding value and superior image quality
Open-Weights
Tencent officially open sources HunyuanVideo, the industry's largest video generation model with 13 billion parameters, achieving leading performance in video quality and motion stability
Open-Weights
Text to imageStability AI launches three new ControlNet models for Stable Diffusion 3.5 Large, including Blur, Canny, and Depth, providing more precise control capabilities for image generation
Open-Weights