AI Coding Live News

Three new open-source embodied AI frameworks overcome observation-action overfitting in Vision-Language-Action (VLA) policies: Zhejiang University's 2B VLA-Δ (arXiv:2610.21306, 54 upvotes) supervises explicit physical state transitions with zero inference overhead to set a 98.4% SOTA on LIBERO; SJTU and HKU's OneWM (arXiv:2610.21095, 40 upvotes) unifies causal world and action modeling to reach 36.68% on RoboCasa365 (over 2x π0.5 at 16.90%); and UIUC/Amazon's CoDA (arXiv:2610.22362) co-evolves simulation data engines and action policies via Text2potential shaping, raising LIBERO-Pro success from 25% to 84% under position perturbations and from 1% to 76% under instruction perturbations.

Zoom

Enabling service robots to execute open-ended human navigation requests across unfamiliar environments (such as locating reading glasses on a living room table and navigating to them) represents a critical challenge in embodied AI. Conventional navigation models rely heavily on domain-specific fine-tuning within specific simulated datasets, resulting in brittle real-world generalization when deployed in unseen layouts. Researchers from Zhejiang University's 3DV Lab introduce SuperNav (arXiv:2610.12126, code: github.com/zju3dv/SuperNav, project: zju3dv.github.io/SuperNav), an open-source agentic navigation framework that achieves universal scene navigation with zero navigation-specific fine-tuning. SuperNav decouples high-level cognitive reasoning—delegated to a frozen, off-the-shelf Multimodal Large Language Model (MLLM)—from low-level physical control executed by specialized robotic navigation tools. Utilizing a Unified Visual-Point Interface where the MLLM marks normalized coordinates directly on observation images, the agent revises decisions continuously based on visual feedback. Validated in the HM3D virtual benchmark and deployed on a real Unitree Go2 quadruped robot across multi-object and demand-driven navigation tasks, SuperNav decisively outperforms fine-tuned baselines.

Zoom

Interactive virtual environments allow embodied AI agents to learn through exploration and practice, but creating worlds that are simultaneously faithful (rigid state dynamics and programmatic rules) and realistic (photorealistic visual distributions) has remained a critical bottleneck: physics engines lack visual fidelity, whereas generative video models suffer from compounding visual hallucinations during extended agent interactions. MirroS Lab and researchers introduce AgentGarten (arXiv:2610.12374, repo: github.com/MirroS-Lab/AgentGarten, site: mirros-lab.github.io/agent-garten), an open-source framework that decouples physics simulation backends from a shared neural renderer. Simulators maintain ground-truth state and execute code-defined rules without ingesting rendered frames, strictly preventing error accumulation. Visual observations are synthesized in real-time (>30 FPS) from exported geometric conditions via a neural renderer trained with Adversarial Forcing, making history prefilling differentiable through exact replay. Agents learn through visual perception, distilling execution trajectories into playbooks that succeeding generations inherit. In benchmarks such as hide-and-seek, agents autonomously discover obstacle-moving and ramp-climbing tactics in just 4 to 10 rounds (compared to tens of millions of rounds in classic RL), with code and environments fully open-sourced.

Zoom

Inverse graphics—interpreting raw visual inputs into executable generative code representing scene geometry and dynamics—constitutes a foundational cognitive frontier for physical world models and embodied agents. Existing code generation benchmarks remain confined to static 2D/3D geometries or conversational software development, failing to assess an agent's grasp of physical causality. Researchers from Stanford University, MIT, and Johns Hopkins introduce 4DCodeBench (arXiv:2610.03715), the first benchmark evaluating agents on 4D inverse graphics through executable code synthesis. Agents must parse dynamic videos and implement compact abstractions such as physics simulators to reproduce observed continuum behaviors, including fluid dynamics, non-rigid deformation, and structural fractures. Evaluating frontier models reveals a stark capability gap: models with strong static 3D spatial reconstruction fail to generate executable simulations for complex time-evolving dynamics. 4DCodeBench establishes an open-source testbed and dataset to measure how coding agents interpret the physical dynamics of the physical universe.

Zoom

KRAFTON and PUBG Studios have released 'PUBG Ally: A Conversational Embodied Agent as an AI Teammate' (arXiv: 2609.29837), unveiling the first voice-enabled, real-time conversational embodied agent deployed in AAA competitive gaming. Addressing the challenge of synchronizing spoken dialogue with high-frequency tactical gameplay under strict latency constraints, Ally couples an LLM meta-agent for tactical reasoning, speech interpretation, and contextual tool use with a decoupled high-speed control layer for movement, combat, and healing. Iteratively trained on nearly 39,000 live sessions with human teammates across 141 countries, Ally boosted player recommendation rates by 25.1 percentage points.

Zoom