AI Coding Live News — Real-Time 𝕏/Twitter Updates & Breakthroughs

SolarRenderer Research@huggingface·Collected 13d ago

👀85

🔥94

SolarRenderer Breaks Generative Video: 4-Step Denoising on Greyboxes and Depths for Real-Time 768p World Synthesis

Researchers from NUS and CUHKSZ have introduced SolarRenderer (arXiv:2610.28630), a structure-conditioned generative reference rendering framework. Converting game engine grey-boxes, pose skeletons, semantic maps, and depth passes into photorealistic video, SolarRenderer adapts a frozen MiniMax-H3 33B backbone via lightweight control and 4-step generation LoRAs. Using structure-guided distribution matching, it renders stylized video in just 4 denoising steps (~12.3x faster than 50-step diffusion) and introduces a block-causal variant for real-time 768p streaming synthesis in generative game engines.

Key Takeaways

SolarRenderer (arXiv:2610.28630) enables high-fidelity video rendering directly from coarse 3D geometry (grey-boxes, skeletons, depth, meshes)
Adapts a frozen MiniMax-H3 33B backbone with lightweight Control and 4-step LoRA modules, preserving visual priors
Requires only 4 denoising steps via structure-guided distribution matching, achieving a 12.3x acceleration over 50-step baselines
Block-causal streaming variant achieves real-time continuous 768p video generation for next-generation generative gaming engines

Read full story

Linked Models & Agents:

⚡ MiniMax-H3⚡ SolarRenderer

#SolarRenderer#Video Generation#Neural Rendering#Game Engine#World Models#Computer Vision

Adina YakupAdinaYakup·Collected 16d ago

👀66

🔥82

View on 𝕏 ↗

VAST open-sources EdenLive, a real-time generative renderer: 5B and 14B weights released, about 24.7 FPS at 720P on a single RTX 5090

VAST, the company behind Tripo, open-sourced EdenLive on GitHub and Hugging Face. A game engine or coding agent runs the rules and world state and outputs a rough reference video; EdenLive renders it in real time into detailed frames, guided by a target first frame and a text prompt. VAST released 5B and 14B weights in bidirectional and few-step autoregressive variants, real-time streaming inference code, and a skill that turns a text prompt into a playable game prototype. Per VAST, the project page shows over 24 FPS, minute-long generation and 480P/720P output; with LightX2V the 5B model reaches about 24.7 FPS at 1280x704 on one RTX 5090.

Key Takeaways

The idea is to split state from appearance: an upstream program or engine keeps the rules and world state, and EdenLive only renders the reference video into detailed frames.
Released: 5B and 14B weights (bidirectional and few-step chunk-AR), real-time streaming inference code, the game-prototype-turbo skill and a frontend workbench.
Per VAST: over 24 FPS, minute-long generation, 480P/720P output; with LightX2V the 5B model reaches about 24.7 FPS at 1280x704 on one RTX 5090.
Built on Wan2.1-I2V-14B (480p) and Wan2.2-TI2V-5B (720p); the full weight tree is about 210 GB, and the verified setup is an 80 GB NVIDIA GPU with CUDA 13.
Licensing caveat: first-party code is Apache 2.0, but the workbench first-frame model FLUX.2 [klein] 9B is non-commercial, and the DINOv3 encoder has its own license.

Read full story

Linked Models & Agents:

⚡ EdenLive⚡ Wan2.1⚡ Wan2.2⚡ FLUX.2 klein🤖 Claude Code 🌐 VAST 🌐 Tripo 🌐 LightX2V

#EdenLive#VAST#Tripo

SkyworkSkywork_ai·Collected 20d ago

👀92

🔥88

View on 𝕏 ↗

Skywork open-sources Matrix-Game 4.0: game engine owns state, a 5B causal video model renders playable games in real time on one GPU

Skywork AI (Kunlun Tech) open-sourced Matrix-Game 4.0 on 2026-10-15. An executable game engine owns world state, physics and rules and emits a cheap low-poly RGB proxy; a 5B causal video model built on Wan2.2-Fun-5B-Control re-renders it into finished frames with 1–2 denoising steps. Inference code, a WebRTC browser demo and game source (Apache-2.0) are on GitHub, with Castle, Ancient Egypt and City Racing weights on Hugging Face. Skywork claims 480p/60 FPS and 112 ms end-to-end on an RTX 5090; the repo's own A100 measurements are ~38–39 FPS. Training code and data are not released.

Key Takeaways

Scale: each scene checkpoint has 5,001,016,512 BF16 params on an alibaba-pai/Wan2.2-Fun-5B-Control base, output 480×864 (HF card)
Vendor claim (RTX 5090): 480p at 60 FPS, 112 ms end-to-end, up to 83.4 FPS generation; repo-measured on one A100-80GB: ~38–39 FPS for Castle/Egypt fixed prompts, ~28.9 FPS for Racing dynamic prompts (v4 README)
Presets: realtime = TAEHV codec + 1-step denoise + CUDA graphs; quality = Wan VAE + 2 steps; 21-latent attention cache incl. sink, 4 frames per chunk
License: code and scene weights Apache-2.0; no training code or data; weights need the Matrix-Game 4.0 runtime (not drop-in Diffusers)
Design: a harness where the engine owns state and rules, a coding agent turns natural-language requests into new rules and prompts, and the video model only renders

Read full story

Linked Models & Agents:

⚡ matrix-game-4.0⚡ wan2.2-fun-5b-control🌐 skywork 🌐 kunlun-tech 🌐 huggingface

#Skywork#Matrix-Game 4.0#Coding Agent#Hugging Face