AI Coding Live News

X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back

On the Cheeky Pint podcast with Stripe co-founder John Collison, published October 29, Sam Altman discussed the memory shortage. He said many people assume open-source models and local inference solve the compute crunch, but from a global allocation perspective it is "quite terrible" for everyone to have scarce DRAM sitting in their own computer and being used about 5% of the time, and that a supply-constrained world wants maximum utilization in the cloud. A pubity post quoting him drew more than 26,000 likes and over 8 million views, and many users pushed back that PC memory is not only for AI and that local models matter for privacy and offline use. This is a summary of an X discussion, not a verified conclusion.

X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back

Key Takeaways

  • Source: Sam Altman on the Cheeky Pint podcast, published October 29, with an official transcript that includes "being used 5% of the time"
  • Altman's argument: with DRAM supply tight, memory in personal computers sits mostly idle, while cloud data centers can serve many users continuously, so utilization should be maximized there
  • Engagement (X API, read Oct 31 13:06 SGT): the pubity post had 26,124 likes, 8,557 quotes, 5,210 replies and about 8.06 million views
  • Main pushback: PC memory also runs the OS, browsers and games; local models keep data on the device; some note the view matches OpenAI's cloud business model
  • Altman did not explain the 5% figure, and coverage suggests treating it as a rough estimate, not a measurement
Read full story
Linked Models & Agents:

OpenHands v1.23.0 Released: Upgraded Multi-Agent Orchestration & Autonomous Regression Validation

OpenHands (@OpenHandsAI, formerly OpenDevin) has released v1.23.0. This release significantly upgrades the multi-agent execution pipeline and sandboxed runtime, introduces automated regression evaluation suites for complex repositories, and enhances compatibility with local inference backends like vLLM and Ollama.

OpenHands v1.23.0 Released: Upgraded Multi-Agent Orchestration & Autonomous Regression Validation

Key Takeaways

  • Introduces tri-agent architecture (Planner, Coder, Verifier) for robust end-to-end PR resolution.
  • Local Docker sandbox runtime execution latency reduced by 35% with real-time file event watchers.
  • Built-in SWE-bench Verified regression runner for local evaluation of custom agent policies.
  • Full source code and container images released on GitHub with native local backend support.
Read full story

Inco open-sources Splash: ~144 tok/s for Qwen3.8-27B on M5 Max

Inco AI open-sourced Splash, a local inference engine built for Apple silicon and models like Qwen3.8-27B. On an M5 Max MacBook Pro it reports about 144 tok/s—up to 3× Ollama, 2× oMLX, and nearly 4× when an agent fans out sub-agents. LM Studio shipped day-0 support under Settings > Runtime > Experimental backends.

Key Takeaways

  • Open-source Splash: local inference tuned for Apple silicon and Qwen3.8-27B.
  • Demo: ~144 tok/s on M5 Max; up to ~3× Ollama / 2× oMLX, nearly 4× with agent fan-out.
  • LM Studio day-0 support; repo github.com/incoai/splash; blog lmstudio.ai/blog/splash-engine.
Read full story

Magnitude open-source local inference server: hardware-fit models for Codex / Claude Code / Cline / Hermes

Open-source magnitudedev/magnitude (Apache-2.0, ~3.1k stars) is a local inference server that profiles your hardware, recommends fitting local models, then downloads, tunes, and runs them — plugged into Codex, Claude Code, Cline, and Hermes. Models load on demand and unload when memory is tight, so coding agents can use local models without a separate stack.

Key Takeaways

  • Open source: magnitudedev/magnitude, Apache-2.0, ~3.1k stars.
  • Features: hardware profiling, local model picks, on-demand load/unload.
  • Integrations: Codex, Claude Code, Cline, Hermes.
Read full story
Linked Models & Agents:
ADSponsored

Perplexity open-sources Lily — local inference engine for Qwen3.6 on Apple silicon

Perplexity (@Perplexity_AI) open-sources Lily, the local inference engine built for hybrid compute in Perplexity Computer. Lily is specialized for Qwen3.6-35B-A3B on Apple silicon so on-device compute does not bottleneck Computer tasks.

Key Takeaways

  • Official open-source of Lily for Perplexity Computer hybrid local/cloud compute.
  • Specialized local inference for Qwen3.6-35B-A3B on Apple silicon.
  • Goal: keep on-device inference from bottlenecking Computer agent tasks.
Read full story

Hugging Face Releases State of Open Models Report: Qwen Series Leads Global Local Inference Ecosystem

Hugging Face published its Summer 2026 State of Open Models report, highlighting Alibaba Qwen's dominance in on-device deployment and developer tooling, accounting for over 40% of local open-model inference.

Key Takeaways

  • Alibaba Qwen captures over 40% market share across local tooling and on-device developer environments;
  • Quantization advances and sparse attention enable long-horizon agent execution on consumer GPUs;
  • SWE-bench performance gap between open weights and closed frontier models narrowed to under six months.
Read full story