Tooling5d ago
LM Studio Bionic 1.1.10 adds the oMLX engine, bringing RAM-plus-SSD KV caching and MLX speculative decoding to local models on Macs
LM Studio posted on X at 15:32 UTC on Oct 29 that users can now download a new oMLX engine inside LM Studio and run it with MLX models they already have. The official changelog lists it in Bionic 1.1.10, alongside speculative decoding for MLX models and an in-app terminal. oMLX is an open-source Apple Silicon inference server maintained by developer jundot (Apache 2.0, about 23,000 GitHub stars) built around continuous batching and a two-tier RAM and SSD KV cache. LM Studio has not published speed comparisons for the engine.
Benchmark2d ago
Memdoor reproduces GVS5H: a team of five Qwen3.8-27B agents averages 9.8/10 on the first 10 LiveCodeBench Hard problems, against 8.0 for a single Fable 5 call
On Oct 31 the open-source coding agent Memdoor (GitHub guregodevo/memdoor, Apache 2.0) published its team-solve workflow: using the GVS5H paper authors' exact prompts and loop, five Qwen3.8-27B instances act as planner, two ideators, solver and manager, talk only through files on disk, and a script that runs the tests decides success. Over five passes on the first 10 LiveCodeBench Hard problems from the GVS5H list it averaged 9.8/10, against 9.6 for the authors' own harness and 8.0 for a single Fable 5 call; 49 of 50 runs solved the problem for $35.79 in total, and every request and reply is public. The Hacker News post has about 200 points. This is a community reproduction on only 10 problems, and the author notes that training-data contamination cannot be ruled out.
Pricing4d ago
X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back
On the Cheeky Pint podcast with Stripe co-founder John Collison, published October 29, Sam Altman discussed the memory shortage. He said many people assume open-source models and local inference solve the compute crunch, but from a global allocation perspective it is "quite terrible" for everyone to have scarce DRAM sitting in their own computer and being used about 5% of the time, and that a supply-constrained world wants maximum utilization in the cloud. A pubity post quoting him drew more than 26,000 likes and over 8 million views, and many users pushed back that PC memory is not only for AI and that local models matter for privacy and offline use. This is a summary of an X discussion, not a verified conclusion.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.