AI Coding Live News

Zhejiang University & Tencent Open-Source KnowGPO for Deep Search Agents: Knowledge-Grouped RL Outperforms 32B Models, Scoring 40.2 on GAIA

Deep search agents struggle with credit assignment across long, noisy retrieved contexts. Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331, GitHub: ZJU-REAL/KnowGPO), an RL framework that groups search trajectories by atomic knowledge conditions rather than surface observations. Qwen3-8B fine-tuned with KnowGPO achieves 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming GRPO/GiGPO baselines and rivaling 32B open-source search systems.

Zhejiang University & Tencent Open-Source KnowGPO for Deep Search Agents: Knowledge-Grouped RL Outperforms 32B Models, Scoring 40.2 on GAIA

Key Takeaways

  • Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331) for credit assignment in deep search agents
  • Replaces surface observation matching with atomic knowledge condition states and within-group incremental knowledge rewards
  • Qwen3-8B + KnowGPO scores 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming standard GRPO by +5.9 and +5.2 points
  • Allows an 8B model to rival and outperform 32B open-source search systems including WebSailor-32B and ASearcher-Web-32B
Read full story
Linked Models & Agents:

ZJU's InfiniSplat v2 Cuts Feed-Forward 3DGS Perceptual Error by 32.9% (118 HF Upvotes), While Technion's H-DDCM Enables Single-GPU Streaming Generative Video Compression

Two new 3D vision and generative compression frameworks solve long-standing efficiency and quality bottlenecks: Zhejiang University's InfiniSplat v2 (arXiv:2610.20341, 118 upvotes on HF) decouples geometry and Gaussian attribute prediction with a frozen geometry branch and large-angle supervision, slashing mean LPIPS by 25.8% and DISTS by 32.9% across six 3D datasets. Meanwhile, Technion's H-DDCM (arXiv:2610.18125) replaces dense Gaussian codebooks in training-free diffusion compression with implicit Walsh-Hadamard dictionaries—requiring O(d log d) compute and O(d) memory—to enable near-real-time streaming video compression on a single GPU.

ZJU's InfiniSplat v2 Cuts Feed-Forward 3DGS Perceptual Error by 32.9% (118 HF Upvotes), While Technion's H-DDCM Enables Single-GPU Streaming Generative Video Compression

Key Takeaways

  • Zhejiang University's InfiniSplat v2 (118 HF upvotes) freezes the geometry branch and applies large-angle supervision to cut pose-conditioned mean LPIPS by 25.8% (0.2472) and DISTS by 32.9% (0.1163) across six 3D datasets
  • In the pose-free setting, InfiniSplat v2 achieves SOTA mean LPIPS of 0.3026 and DISTS of 0.1341, outperforming WorldMirror 2.0 (0.3757 / 0.1935) and AnySplat
  • Technion's H-DDCM replaces dense Gaussian codebooks with implicit Walsh-Hadamard dictionaries (O(d log d) compute, O(d) memory) and periodic KV-cache prefix re-encoding for single-GPU streaming video compression
Read full story
Linked Models & Agents:

4.36x Faster World Model Attention with Zero Training: NUS Introduces Velox Spatial Memory, Alongside Nankai's DeltaStreamer and HKPolyU's CoWorld Reasoner

Four new studies advance interactive video world models and streaming video agents: NUS's training-free Velox router (arXiv:2610.22311) uses 3D camera frustum-slab correspondences on H200 GPUs to accelerate chunk-48 attention by 4.36x and denoising by 2.43x with negligible quality loss; Nankai University's DeltaStreamer (arXiv:2610.19849, 39 upvotes) combines change-aware memory with targeted frame replay to reach 66.07% on OVO-Bench; HKPolyU's CoWorld Reasoner (arXiv:2610.21910) co-evolves a VLM-VWM tool harness for +13.0% relative gains on ERQA; and Zhejiang University releases the 260-case WorldMemBench (arXiv:2610.19063).

4.36x Faster World Model Attention with Zero Training: NUS Introduces Velox Spatial Memory, Alongside Nankai's DeltaStreamer and HKPolyU's CoWorld Reasoner

Key Takeaways

  • NUS's training-free Velox router uses 3D camera frustum slabs on H200 to speed up chunk-48 attention by 4.36x and denoising by 2.43x within 0.15 points of dense attention on WBench
  • Nankai University's DeltaStreamer combines change-aware memory with targeted frame replay to achieve 66.07% on OVO-Bench and 59.53% on StreamingBench
  • HKPolyU's CoWorld Reasoner co-evolves a VLM-VWM imagination harness for +11.8% (MMSI) and +13.0% (ERQA) relative gains, alongside ZJU's 260-case WorldMemBench
Read full story
Linked Models & Agents:

ZJU's VLA-Δ Sets 98.4% LIBERO Record, SJTU/HKU's OneWM Doubles π0.5 on RoboCasa365, and CoDA Lifts Perturbed Robot Success from 1% to 76%

Three new open-source embodied AI frameworks overcome observation-action overfitting in Vision-Language-Action (VLA) policies: Zhejiang University's 2B VLA-Δ (arXiv:2610.21306, 54 upvotes) supervises explicit physical state transitions with zero inference overhead to set a 98.4% SOTA on LIBERO; SJTU and HKU's OneWM (arXiv:2610.21095, 40 upvotes) unifies causal world and action modeling to reach 36.68% on RoboCasa365 (over 2x π0.5 at 16.90%); and UIUC/Amazon's CoDA (arXiv:2610.22362) co-evolves simulation data engines and action policies via Text2potential shaping, raising LIBERO-Pro success from 25% to 84% under position perturbations and from 1% to 76% under instruction perturbations.

ZJU's VLA-Δ Sets 98.4% LIBERO Record, SJTU/HKU's OneWM Doubles π0.5 on RoboCasa365, and CoDA Lifts Perturbed Robot Success from 1% to 76%

Key Takeaways

  • Zhejiang University's 2B VLA-Δ explicitly supervises physical state transitions with zero inference overhead, setting a 98.4% SOTA on LIBERO and beating π0.5 by +6.4 points under language perturbations
  • SJTU and HKU's OneWM unifies causal world and action modeling, achieving 36.68% overall success on RoboCasa365 (2.17x π0.5) and leading OOD LIBERO-Plus at 59.27%
  • UIUC/Amazon's CoDA co-evolves simulation engines and policies via Text2potential shaping, raising LIBERO-Pro success from 25% to 84% under position perturbations and from 1% to 76% under instruction perturbations
Read full story
Linked Models & Agents:
ADSponsored

SuperNav: ZJU Open-Sources Zero-Finetuning Embodied Navigation Agent Deployed on Quadruped Robots

Enabling service robots to execute open-ended human navigation requests across unfamiliar environments (such as locating reading glasses on a living room table and navigating to them) represents a critical challenge in embodied AI. Conventional navigation models rely heavily on domain-specific fine-tuning within specific simulated datasets, resulting in brittle real-world generalization when deployed in unseen layouts. Researchers from Zhejiang University's 3DV Lab introduce SuperNav (arXiv:2610.12126, code: github.com/zju3dv/SuperNav, project: zju3dv.github.io/SuperNav), an open-source agentic navigation framework that achieves universal scene navigation with zero navigation-specific fine-tuning. SuperNav decouples high-level cognitive reasoning—delegated to a frozen, off-the-shelf Multimodal Large Language Model (MLLM)—from low-level physical control executed by specialized robotic navigation tools. Utilizing a Unified Visual-Point Interface where the MLLM marks normalized coordinates directly on observation images, the agent revises decisions continuously based on visual feedback. Validated in the HM3D virtual benchmark and deployed on a real Unitree Go2 quadruped robot across multi-object and demand-driven navigation tasks, SuperNav decisively outperforms fine-tuned baselines.

SuperNav: ZJU Open-Sources Zero-Finetuning Embodied Navigation Agent Deployed on Quadruped Robots

Key Takeaways

  • Zhejiang University open-sources SuperNav, delivering universal embodied navigation with zero domain fine-tuning
  • Decouples cognitive reasoning from physical execution via a Unified Visual-Point Interface on 2D images
  • Outperforms fine-tuned baselines on HM3D and physical Unitree Go2 quadrupeds, maintaining 88%+ success in unseen scenes
Read full story

ViSkill: Zhejiang University REAL Lab Unveils Evolving Visual-Native Skills for VLM Agents, Elevating Success Rates to 91%

In spatially demanding environments such as GUI operating systems and spatial grid puzzles, multimodal foundation agents improve sample efficiency by distilling past successful trajectories into reusable strategies. However, existing skill-augmented paradigms remain strictly text-centric: they linearize continuous spatial layouts, geometry, and visual action-state correspondences into text strings, discarding essential structural properties. Researchers from Zhejiang University's REAL Lab unveil ViSkill (arXiv:2610.12403), a visual-native skill learning framework for Vision-Language Model (VLM) agents. ViSkill encodes successful interactions directly as composite visual skill cards natively accessible to VLM backbones. Retrieved visual skills guide online policy inference while simultaneously shaping step-level rewards. Successful new trajectories are distilled back into the visual skill library, creating a closed reinforcement feedback loop where skill accumulation and policy optimization mutually enhance each other. Across spatial reasoning benchmarks including Sokoban, FrozenLake, and PrimitiveSkill, ViSkill registers an overall success rate of 0.89 (climbing to 0.91 with cold-start initialization), outperforming proprietary and open-source baselines while converging significantly faster than standard PPO, with code fully open-sourced.

Key Takeaways

  • Zhejiang University releases ViSkill, introducing composite visual skill cards to replace lossy textual skill representations in VLM agents
  • Achieves 0.89 to 0.91 success rates across spatial reasoning tasks while converging over 2x faster than standard PPO
  • Establishes a closed-loop flywheel between visual skill accumulation and policy reinforcement, with code fully open-sourced
Read full story
Linked Models & Agents:

Does Learning Protein Folding Generalize to Broader Reasoning? Fold2Reason Transfers 3D Structural Logic to Boost 10 General Reasoning Benchmarks

Large language models predominantly rely on human natural language texts, often capturing surface linguistic statistical patterns rather than intrinsic spatial logic and structural topologies. Researchers from Zhejiang University, SJTU, and BioMap propose Fold2Reason (arXiv:2609.38879), investigating whether learning protein folding—where each resolved crystal structure provides thousands of rigorously verifiable 3D spatial and topological constraints—transfers reusable reasoning capabilities to general LLMs. They construct FoldingCorpus and train via Fold2Reason using two complementary signals: discrete structural answers via native language heads and continuous 3D geometry decoded from shared representations. On FoldBench, Fold2Reason scores 2.7x to 3.5x higher than Qwen3.5-9B; crucially, it generalizes across all 10 evaluated benchmarks spanning spatial, graph, scientific, and general reasoning, raising macro-average accuracy from 45.09% to 48.33% (+3.23 pp) with uniform positive gains.

Does Learning Protein Folding Generalize to Broader Reasoning? Fold2Reason Transfers 3D Structural Logic to Boost 10 General Reasoning Benchmarks

Key Takeaways

  • Pioneers Fold2Reason, empirically proving that learning protein 3D folding systematically transfers to generalized reasoning
  • Pairs native discrete language heads with shared continuous 3D geometric decoding, achieving 2.7x-3.5x FoldBench gains over Qwen3.5-9B
  • Delivers uniform positive gains across all 10 spatial, graph, and scientific reasoning benchmarks, lifting macro accuracy by +3.23 pp
Read full story

Scaling Properties of Same-Family On-Policy Distillation: Compact RL Teachers Transfer Better to Larger Students via Power Laws

While reinforcement learning induces profound reasoning capabilities in LLMs, the scaling laws governing how and how fast this capability transfers across model sizes via on-policy distillation (OPD) have remained unquantified. Researchers from Zhejiang University and collaborating institutions present a definitive empirical analysis (arXiv:2609.32722, 310+ upvotes on Hugging Face) across weak-to-strong, same-base, and strong-to-weak distillation regimes. The study identifies a universal 'useful-transfer regime' where held-out task accuracy scales linearly with the square root of token-level reverse KL divergence from initialization. Remarkably, across all weak-to-strong pairings, student peak performance strictly surpasses the RL teacher itself. The authors formalize empirical power laws for OPD, demonstrating that smaller RL expert teachers paradoxically deliver superior supervisory density compared to bloated teachers of matched accuracy.

Scaling Properties of Same-Family On-Policy Distillation: Compact RL Teachers Transfer Better to Larger Students via Power Laws

Key Takeaways

  • Establishes empirical scaling properties and power laws for same-family on-policy distillation across model scales
  • Confirms weak-to-strong distillation consistently enables larger students to surpass their supervising RL teachers
  • Reveals smaller RL teachers deliver higher supervision efficiency than larger teachers of matched performance
Read full story

ZJU Unveils HybridCUA: Orchestrating GUI and CLI for Computer-Use Agents, Scoring 53.6% on OSWorld with a 14.8% Gain

Existing Computer-Use Agents (CUAs) face a dilemma: relying strictly on graphical user interface (GUI) interactions is slow and error-prone, while building per-application API tools demands unsustainable engineering and lacks generalizability. Researchers from Zhejiang University introduce HybridCUA, combining the UI versatility of GUIs with the execution speed and determinism of the Command Line Interface (CLI). Supported by the newly constructed HybridCUA-8K dataset (5K hybrid trajectories and 3K RLVR tasks), HybridCUA employs a two-stage training paradigm: supervised fine-tuning across interleaved GUI-CLI modalities, followed by CLI-aware reinforcement learning that rewards reliable, selective shell execution. On the OSWorld benchmark, HybridCUA-9B achieves 53.6% accuracy, improving over the base model by 14.8 percentage points, while delivering a 4.0-point gain on WindowsAgentArena.

ZJU Unveils HybridCUA: Orchestrating GUI and CLI for Computer-Use Agents, Scoring 53.6% on OSWorld with a 14.8% Gain

Key Takeaways

  • Unified GUI and CLI Paradigm: Bridges the gap between fragile vision-only screen clicking and application-specific APIs, combining the speed of shell commands with the visual ubiquity of desktop GUIs.
  • HybridCUA-8K Trajectory Dataset: Curates 5,000 interleaved GUI-CLI trajectories and 3,000 verified RLVR tasks with ground-truth environment state feedback for agent post-training.
  • 53.6% on OSWorld with Cross-OS Generalization: HybridCUA-9B hits 53.6% accuracy on OSWorld (a 14.8 percentage point gain over base) and boosts WindowsAgentArena by 4.0 points across distinct OS environments.
Read full story
Linked Models & Agents:
⚡ HybridCUA-9B⚡ Qwen2-VL-7B⚡ Claude-3.5-Computer-Use⚡ OSWorld-Agent🤖 Computer-Use Agent🤖 HybridCUA🤖 Desktop Agent🌐 Zhejiang University🌐 Hugging Face🌐 arXiv

WideSWE: First Multi-Repository Benchmark for Coding Agents Spans 103 Ecosystems, Top Success Capped at 42.5%

Addressing the fundamental limitation of benchmarks like SWE-bench that assess coding agents strictly within isolated repositories, researchers from Zhejiang University introduced WideSWE. Mining changes across 103 real-world software ecosystems, WideSWE establishes 120 cross-repository tasks (balanced between 60 bug fixes and 60 feature developments) with comprehensive regression test suites. Across seven frontier agent configurations, full task success tops out at just 42.50%, exposing systemic failures in cross-repo dependency tracking and coordinated verification.

WideSWE: First Multi-Repository Benchmark for Coding Agents Spans 103 Ecosystems, Top Success Capped at 42.5%

Key Takeaways

  • Cross-Repository Benchmark Evolution: Moves beyond single-codebase evaluations by capturing interdependent multi-repository modifications across 103 real-world open-source software ecosystems.
  • Frontier Agents Top Out at 42.50%: Across seven leading agent setups, end-to-end task completion ranges from 10.83% to 42.50% (Codex CLI + GPT-5.6-sol achieving the high mark), exposing acute bottlenecks in cross-repo dependency coordination.
  • Isolated vs. Joint Workflow Dynamics: Proves that treating repositories independently leads to omitted cross-system dependencies, whereas joint execution surfaces essential multi-repo type signatures and test harness context.
  • Complete Open-Source Test Harness: Benchmark code, environmental harnesses, and evaluation suites released at github.com/ZJU-ACES-ISE/WideSWE.
Read full story
Linked Models & Agents:
ADSponsored

Tencent and ZJU Open-Source IterSynth: Decoupled Deep-Search Agent Architecture Outperforms Existing 8B Baselines

Tencent and Zhejiang University's REAL Lab have open-sourced IterSynth (arXiv: 2609.29444, GitHub: Tencent/IterSynth), a groundbreaking paradigm for deep-search AI agents. Breaking free from the rigid single-agent ReAct framework where planning, evidence retrieval, and synthesis are tightly coupled—which typically causes severe context saturation and attention degradation—IterSynth alternates between a specialized Planner and a Synthesizer governed by an evolving summary state. Powered by Role-Decoupled Policy Optimization (RDPO), IterSynth-8B hits an average score of 50.7 across long-horizon benchmarks like BrowseComp and Xbench-DS, outperforming all prior <=8B search agents by +4.2%.

Tencent and ZJU Open-Source IterSynth: Decoupled Deep-Search Agent Architecture Outperforms Existing 8B Baselines

Key Takeaways

  • Decouples single-policy ReAct agent architectures into specialized Planner and Synthesizer roles.
  • Maintains an evolving summary state that slashes token context noise from multi-hop web scraping by 70%.
  • Introduces Role-Decoupled Policy Optimization (RDPO) combining terminal rewards with fine-grained rubric evaluations.
  • IterSynth-8B achieves a record 50.7 score on BrowseComp and Xbench-DS, lifting zero-shot reasoning on proprietary models.
  • Complete PyTorch training harness, benchmarks, and checkpoints open-sourced on GitHub under Tencent.
Read full story

Zhejiang University Open-Sources Spatial-Interactor: Closed-Loop Physical World Spatial Reasoning with LSI-108K

Researchers from Zhejiang University's OmniAI Lab have open-sourced Spatial-Interactor alongside the LSI-108K interactive spatial reasoning dataset (arXiv: 2609.23038). Addressing severe 3D hallucination in passive vision-language models, Spatial-Interactor introduces closed-loop active perception where an agent's physical camera-control actions inform subsequent spatial inferences, fully accessible under the Apache 2.0 license.

Zhejiang University Open-Sources Spatial-Interactor: Closed-Loop Physical World Spatial Reasoning with LSI-108K

Key Takeaways

  • Replaces passive single-image inspection with active, multi-view camera manipulation to resolve spatial occlusions.
  • Releases LSI-108K, the first large-scale interactive spatial dataset spanning 108,000 closed-loop trajectories.
  • Improves 3D object localization, bounding box estimation, and obstacle avoidance accuracy by 33.8% on average.
  • Complete PyTorch training scripts, evaluation benchmarks, and checkpoints open-sourced under Apache 2.0 on GitHub.
Read full story
Linked Models & Agents:
⚡ Spatial Interactor⚡ Qwen 2 Vl🤖 embodied-agent🌐 zhejiang-university