AI Coding Live News

CapCut announces a ChatGPT plugin is coming soon, bringing its video generation and editing tools inside ChatGPT with drafts that move to the CapCut web editor

At 18:34 UTC on 2026-10-24, during its CapCut World event in Los Angeles, ByteDance's CapCut announced from its official account (@capcutapp) that a new CapCut plugin is coming soon to ChatGPT (post). According to CapCut, the plugin brings its video editing and generation tools inside ChatGPT: users can start with an idea in ChatGPT, create it with the plugin right in the chat, then move the draft to the CapCut web editor to refine and publish. When we pulled it, the post had about 3,646 likes, 319 reposts, 504 replies and 450K views. The event site lists OpenAI's Head of Partnerships Mahak Sharma and Head of Creator Product Sam Yam as speakers. Many creator posts on X say the plugin is already in early access on ChatGPT desktop with mobile and web around mid-November, but CapCut's own post still says coming soon, so timing and pricing should be taken from CapCut's later announcements.

Key Takeaways

  • Official source: CapCut's post on X, published 18:34 UTC on 10-24, with about 3,646 likes, 319 reposts, 216 quotes, 504 replies and 450K views when we pulled it
  • What it does: CapCut's video editing and generation tools inside ChatGPT, so a chat idea can become a video draft directly
  • Workflow: drafts made with the plugin can move to the CapCut web editor for further editing, sharing and publishing
  • OpenAI involvement: the CapCut World Los Angeles site lists OpenAI's Mahak Sharma (Head of Partnerships) and Sam Yam (Head of Creator Product) as speakers
  • Status: CapCut says coming soon; creator claims of desktop early access now and mobile and web in mid-November are not confirmed by CapCut, and pricing is not announced
Read full story

ByteDance's BytePlus launches Seedance 2.5 4K: a native 4K, 10-bit video generation model with a low-cost 480p Draft preview mode

On 2026-10-23 (15:31 UTC), ByteDance's enterprise cloud BytePlus (@BytePlusGlobal) launched Seedance 2.5 4K, calling it the most capable model in the Seedance 2.5 generation. It brings more nuanced facial expressions and movement, fuller textures, contours and fine detail, and 10-bit colour depth for smoother gradations that suit the big screen. A new Draft mode lets creators test storyboards and refine shots with lower-cost 480p previews, then render the final version in 4K. It is currently available only to selected enterprise customers, and BytePlus says API availability updates are coming. It debuted in the short film "Otter is Nobody 2".

ByteDance's BytePlus launches Seedance 2.5 4K: a native 4K, 10-bit video generation model with a low-cost 480p Draft preview mode

Key Takeaways

  • The most capable model in the Seedance 2.5 generation, with native 4K output (official announcement)
  • More nuanced facial expressions and movement, with fuller textures, contours and fine detail
  • 10-bit colour depth for richer gradations and smoother transitions
  • Draft mode: refine storyboards with low-cost 480p previews, then render the final cut in 4K
  • Selected enterprise customers only for now; no public API, pricing or benchmarks yet
Read full story
Linked Models & Agents:
⚡ Seedance 2.5 4K🌐 ByteDance🌐 BytePlus

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds via Executable Harness

Researchers introduced Matrix-Game 4.0 in arXiv:2610.27999, bridging the chasm between controllable video generation and genuinely playable, interactive virtual worlds. Current video world models suffer from severe state hallucination, inability to enforce rigid game mechanics (collision physics, inventory, win/loss rules), and sluggish response latency. Matrix-Game 4.0 resolves these barriers by decoupling game logic execution from visual synthesis through an executable game harness. A lightweight runtime tracks deterministic game states and rules, steering high-fidelity streaming video backbones to deliver playable, persistent, and low-latency virtual game environments.

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds via Executable Harness

Key Takeaways

  • Matrix-Game 4.0 introduced in arXiv:2610.27999, architecting a decoupled paradigm separating game rule execution from generative video synthesis
  • Employs an executable game harness maintaining deterministic physics, collision boundaries, and game state, eliminating visual state drift
  • Transitions generative AI from passive controllable video playback to genuinely playable interactive game sandboxes
  • Maintains low-latency streaming inference, establishing an open blueprint for next-generation AI-native game design and interactive simulations
Read full story
Linked Models & Agents:

Kandinsky 6.0 Video Released: Open-Source Foundation Models for Synchronized 1080P Video and 44kHz Audio Generation

Generating cinematic video accompanied by synchronized, high-fidelity audio represents a premier frontier in multimodal AI. Traditional pipelines rely on disjointed workflows where silent video is generated first and audio is patched in post-hoc, leading to temporal misalignment, unnatural ambient acoustics, and broken lip-sync. The Kandinsky research team releases Kandinsky 6.0 Video (arXiv:2610.05608, code: github.com/kandinskylab/kandinsky-6, Hugging Face Diffusers integration). Powered by a dual-stream CrossDiT (Diffusion Transformer) architecture, Kandinsky 6.0 Video tightly couples a pretrained video generation stream with a newly trained audio stream via bidirectional cross-attention for joint temporal-semantic alignment. Available in two configurations—a 3B Lite variant and a 29B Pro flagship—the model generates 5-second video sequences accompanied by synchronized 44 kHz broadcast-grade audio, featuring native lip-sync and integrated Full-HD (1920x1080) super-resolution. The codebase, model weights, and Diffusers integration are fully released under the permissive MIT license.

Kandinsky 6.0 Video Released: Open-Source Foundation Models for Synchronized 1080P Video and 44kHz Audio Generation

Key Takeaways

  • Kandinsky 6.0 Video released under MIT license, delivering synchronized audiovisual generation from text and images
  • Dual-stream CrossDiT architecture outputs 5s video with 44 kHz broadcast audio and Full-HD 1080p resolution
  • Provides 3B Lite and 29B Pro weights, slashing audiovisual alignment error by 62.4% with native lip-sync
Read full story
Linked Models & Agents:
ADSponsored

WorldGuide: MBZUAI and ANU Introduce Goal-Directed Closed-Loop Video World Model for Procedural Task Execution

Modern video foundation models synthesize photorealistic visual dynamics, yet struggle on long-horizon procedural tasks requiring sequential causal execution—such as equipment maintenance, cooking, or laboratory experiments. Current architectures rely on open-loop generation that cannot adapt to intermediate video outputs, resulting in disordered task sequences, hallucinated progress, and premature task termination. Researchers from MBZUAI and the Australian National University introduce WorldGuide (arXiv:2610.12459, repository: github.com/mbzuai-oryx/WorldGuide, site: mbzuai-oryx.github.io/WorldGuide/), formalizing procedural video generation as closed-loop task execution in visual world space. Given solely an initial image and a high-level task goal, WorldGuide iteratively predicts the next atomic action, generates the corresponding visual video clip, and inspects the synthesized state to dynamically route subsequent actions or determine task completion. A hierarchical visual memory maintains state history under bounded token footprints. To bridge supervision gaps, the authors release WorldGuide-Bench comprising approximately 59K step-annotated videos across 245 tasks and 27 procedural categories. WorldGuide achieves 33.33% Task Success on WorldGuide-Bench, outscoring the strong MiniMax-H3 model (29.90%) even when MiniMax-H3 is provided with reference plans, and surges to 47.69% on VideoCraft-Bench compared to 32.73% for MiniMax-H3 under goal-only conditioning.

Key Takeaways

  • MBZUAI and ANU introduce WorldGuide, formalizing procedural video generation as closed-loop task execution in world space
  • Achieves 33.33% Task Success on WorldGuide-Bench and 47.69% on VideoCraft-Bench, decisively outperforming MiniMax-H3
  • Open-sources WorldGuide-Bench with ~59K step-annotated videos, reducing procedural ordering errors from 62% to under 4%
Read full story
Linked Models & Agents:

MC-Sparse: CUHK and ByteDance Unveil Meta-Cached Sparse Attention for DiTs, Accelerating Video & 3D Generation by 2.32x with Zero Quality Loss

Diffusion Transformers (DiTs) underpin frontier video generation systems and high-fidelity 3D modeling, yet self-attention computation over extreme sequence lengths introduces prohibitive inference latencies and memory bottlenecks. While sparse attention represents a promising acceleration pathway, existing methods suffer substantial visual quality degradation and texture corruption under high sparsity regimes. Researchers from The Chinese University of Hong Kong (CUHK) and ByteDance analyze sparse attention failures in DiTs (arXiv:2610.06801), tracing quality drops to three root causes: rigid token grouping constraints, inaccurate interaction selection, and uncompensated attention residuals from discarded tokens. The authors introduce Meta-Cached Sparse Attention (MC-Sparse, project site: dodododddo.github.io/mcsparse-project-page/), a training-free framework that preserves individual Key-Value (KV) selection precision while organizing similar Queries into tile-aligned blocks for hardware efficiency on GPUs. MC-Sparse caches query clusters, exact KV indices, and dense-sparse attention output residuals, reusing this metadata across downstream denoising timesteps. On Minimax-H3-Base video models, MC-Sparse delivers a 1.80x denoising speedup, and a 2.32x acceleration on 3D generative backbones, maintaining near-identical fidelity to dense attention with zero visible quality degradation.

Key Takeaways

  • CUHK and ByteDance introduce MC-Sparse, leveraging meta-caching to eliminate quality degradation in sparse DiTs
  • Delivers a 1.80x speedup on Minimax-H3-Base and 2.32x on 3D generation while cutting peak memory by 45%
  • Operates training-free with residual compensation, matching dense attention quality across visual benchmarks
Read full story
Linked Models & Agents:
⚡ MC-Sparse⚡ DiT⚡ Minimax-H3-Base⚡ Triton-Sparse🤖 Inference-Optimizer🤖 DiT-Accelerator🌐 CUHK🌐 ByteDance🌐 Hugging Face

Reka releases Rho-1 research preview: a 19B omni-reasoning model trained from scratch that understands and generates text, images and video and emits robot actions in one network

On Oct 5 Reka Labs released a research preview of Rho-1, a 19B omni-reasoning model trained from scratch that unifies text, image, video and robot-action tokens in one network and one KV cache, with no tool calls or second model. Each transformer block has an understanding stream and a generation stream with shared attention, trained jointly with next-token prediction and flow matching. Reka reports base video generation at 0.79x real time (median) and a distilled 8-step variant (vs 99) returning a 5.3s clip in about a second. The checkpoint was trained on 320 H100s for three months. Research preview only; no public weights.

Reka releases Rho-1 research preview: a 19B omni-reasoning model trained from scratch that understands and generates text, images and video and emits robot actions in one network

Key Takeaways

  • Scale: 19B parameters trained from scratch on just 320 H100s for three months
  • Speed: base video at 0.79x real time (median), ~6s to a watchable stream; distilled 99→8 denoising steps returns a 5.3s clip in ~1s
  • Architecture: dual expert streams (understanding/generation) per block with shared attention and one KV cache; next-token + flow-matching objectives
  • Limits: native video capped at 672x384; long-horizon drift, temporal grounding and edit stability are admitted weak points
  • Access: research preview only, no open weights or public API; partnerships via [email protected]
Read full story
Linked Models & Agents:
⚡ Rho 1🌐 reka

ViRDM Framework Released: Teacher- and Critic-Free Representation Distribution Matching for Few-Step Causal Video Generation

Researchers have released ViRDM (arXiv: 2609.28923, Project: neu-vi.github.io/ViRDM/, GitHub: neu-vi/ViRDM), establishing a breakthrough teacher- and critic-free post-training recipe for few-step causal video generation. While prevailing Distribution Matching Distillation (DMD) requires orchestrating a massive pre-trained teacher model alongside an online critic network—demanding unsustainable GPU cluster resources—ViRDM adapts representation distribution matching directly into autoregressive multi-step video diffusion. Requiring a mere 20 generator updates (16 A100 GPU-hours), ViRDM achieves a state-of-the-art 84.87 on the official VBench benchmark.

ViRDM Framework Released: Teacher- and Critic-Free Representation Distribution Matching for Few-Step Causal Video Generation

Key Takeaways

  • Replaces resource-intensive three-network teacher-critic distillation stacks with a streamlined generator-only post-training pipeline.
  • Overcomes memory-intractable gradient propagation paths via stochastically truncated supervision and staged vector-Jacobian products.
  • Introduces lightweight dynamics regularization to enforce temporal consistency without computational bloat.
  • Extremely sample-efficient: requires only 20 updates (16 A100 GPU-hours) to reach 84.87 on the official VBench evaluation suite.
  • PyTorch codebase, few-step streaming rollout recipes, and checkpoints open-sourced on GitHub.
Read full story
Linked Models & Agents:

Alibaba Open-Sources WanPE-397B: Cinematic Prompt Enhancement Model via SC-GRPO Powering Wan3.0 Video Generation

Alibaba's Wan video generation team (@Alibaba_Qwen) has released WanPE (arXiv: 2609.30221, Project: wan-pe.github.io), a 397B-parameter prompt enhancement architecture powering the upcoming Wan3.0 video foundation model. Addressing narrative incoherence and camera drift when scaling text-to-video generation to 30-second sequences, WanPE leverages a video-grounded reverse construction pipeline and Semantic-Consistency GRPO (SC-GRPO) to generate multi-shot cinematic screenplays without deviating from user intent, driving a 50.86-point surge in human preference ratings over raw prompts.

Alibaba Open-Sources WanPE-397B: Cinematic Prompt Enhancement Model via SC-GRPO Powering Wan3.0 Video Generation

Key Takeaways

  • Releases WanPE-397B, the largest open cinematic prompt enhancement model trained on 1.05M real-world cinematic videos.
  • Introduces Semantic-Consistency GRPO (SC-GRPO), eliminating semantic drift where RL rewrites unintentionally alter core user constraints.
  • Employs reverse shot-level construction to plan camera trajectories, lighting, and multi-shot transitions across 5-30s videos.
  • Boosts human preference scores by 50.86 points in 30-second video generations when paired with Alibaba Wan3.0.
  • WanPEval benchmark dataset comprising 11,000 blind pairwise human assessments published on GitHub and project page.
Read full story
Linked Models & Agents:

Shanghai AI Lab Open-Sources AV-GRPO: Modality-Anchored Decoupled Diffusion RL for Joint Audio-Video Generation

Shanghai AI Laboratory has open-sourced AV-GRPO (arXiv: 2609.29816, GitHub: zhiyuxu03/AV-GRPO), a modality-anchored online diffusion reinforcement learning framework for joint audio-video generation. Addressing the persistent audio-visual desynchronization, semantic mismatch, and high compute overhead in coupled diffusion models, AV-GRPO decouples multimodal preference optimization into manageable unimodal subproblems via modality-anchored rollouts and trajectory-locked frozen-tower RL. It delivers state-of-the-art cross-modal synchronization on JavisBench and VABench, substantially outperforming LTX-2.3.

Shanghai AI Lab Open-Sources AV-GRPO: Modality-Anchored Decoupled Diffusion RL for Joint Audio-Video Generation

Key Takeaways

  • Extends Group Relative Policy Optimization (GRPO) to continuous joint audio-visual diffusion reinforcement learning.
  • Implements modality-anchored rollouts and trajectory-locked frozen towers to resolve multimodal credit assignment bottlenecks.
  • Releases 5DAV, the first systematically decoupled 5-dimensional difficulty-controllable training dataset.
  • Outperforms LTX-2.3 on JavisBench and VABench, boosting cross-modal synchronization by 28.4% and semantic alignment by 19.6%.
  • Training scripts, inference recipes, LoRA checkpoints, and datasets published under open-source licenses on GitHub.
Read full story
Linked Models & Agents:
⚡ Av Grpo⚡ Ltx Video⚡ Hunyuan Video🤖 multimodal-agent🌐 shanghai-ai-lab🌐 huggingface
ADSponsored

ByteDance Develops Real-Time Spatial Video Model & Secures .6B AI Credit Facility

ByteDance is developing a real-time spatial video generation foundation model tailored for embodied robotics, physical world simulation, and next-gen Pico XR headsets. Concurrently, ByteDance secured a landmark .6 billion AI credit facility to finance hyperscale GPU clusters.

Key Takeaways

  • Builds real-time spatial video generation foundation models for 3D physics and robotics
  • Secures .6B global syndicated loan facility to finance long-term AI compute expansion
  • Directly integrates with Pico spatial headsets, autonomous driving, and embodied robotics
Read full story
Linked Models & Agents:
⚡ Doubao Video⚡ Spatial World Model🌐 ByteDance

ElevenLabs MCP adds voice, music, image, and video generation across ChatGPT, Claude, Cursor, Grok Bot

ElevenLabs launched a multimodal MCP for voice, transcripts, dubs, music, sound effects, images, and video from assistants you already use. It is live in ChatGPT, Claude, Cursor, Grok Bot, and Hermes from a single install.

Key Takeaways

  • ElevenLabs MCP now generates voice, music, images, and video.
  • Works inside ChatGPT, Claude, Cursor, Grok Bot, and Hermes.
  • Single install covers speech, transcripts, dubs, SFX, and media.
Read full story