NVIDIA released a 120B open multimodal agent model that fits on a single DGX Spark. Nemotron 3.5 Super VL is a mixture-of-experts model with 120 billion total parameters but only 12 billion active at any moment, which is how it fits on one DGX Spark unit. It supports a 1-million-token context window and uses NVFP4 weights, a 4-bit floating point format that trades a small amount of precision for significant memory savings. NVIDIA also released two smaller Bolt edge models alongside it. The full release is open and available now. (MarkTechPost)
Meta and Apple ship Muse Spark Open for local Mac use
Good morning. Friday in AI land, and the hardware companies are in a generous mood. NVIDIA dropped two open models this week, Meta shipped one with Apple's help, and somewhere a 74-billion-parameter vision model is being asked to run on a laptop with 24GB of RAM. The race to put serious models on local hardware used to be a hobbyist project. It is now a product strategy.
Today's reading time is 5 minutes.
Running a frontier-class open-weight model locally on consumer Apple hardware has required significant compromise, usually in context length or multimodal capability.
Driving the news: Meta released Muse Spark Open, which it describes as the most capable US open-weight model to date, with Apple providing MLX framework optimizations so the model runs natively on Apple silicon. The collaboration means the model works on M5 Ultra Mac Studios without cloud routing. Meta says it is the first model in its class to get this kind of hardware-level co-engineering from Apple.
- MLX is Apple's own machine learning framework, optimized for the unified memory architecture in M-series chips.
- The partnership is notable because Apple has historically stayed out of the open-weight model ecosystem entirely.
Zoom in: Meta has been building toward local deployment for months, and the Muse family represents its clearest push yet into on-device inference for creative and agentic workloads. Apple's involvement changes the calculus: MLX support from the chip designer, not a third-party port, means performance headroom that community optimizations rarely reach. The timing also puts pressure on other frontier labs whose open-weight models still require cloud infrastructure to run at full capability.
- Apple has not previously co-launched a third-party open-weight model with hardware-level optimization.
- The M5 Ultra Mac Studio, the target hardware, has enough unified memory to hold large models entirely in RAM.
Why it matters: For creators running local inference pipelines, a Meta model with first-party Apple silicon support removes the usual tradeoff between model quality and on-device speed. Workflows that previously required a cloud API call, with the latency and privacy implications that come with it, can now run on a Mac sitting on a desk. That is a real change for anyone building tools that handle sensitive content or need sub-second response times.
Bottom line: Apple spent years watching the open-weight ecosystem grow without it, and its first move is to make someone else's model run better on its own hardware.
The Verge ↗Also happening
ChatGPT's Chrome extension can now read your open browser tabs. OpenAI updated its Google Chrome extension so that ChatGPT can view whichever tabs you have open when you tag Chrome inside the ChatGPT web or desktop app. This replaces the Atlas browser project OpenAI had been developing as a standalone product. The feature is available now for extension users. It is a meaningful shift in how much ambient context the assistant can pull in without a user manually copying and pasting content. (The Verge)
Open-weight models are now outperforming mid-tier frontier models on filtered benchmarks. A community analysis on r/LocalLLaMA argues that when benchmarks are filtered to remove saturated tasks, open-source models are now beating Sonnet 5, a result that would have been implausible a few months ago. The top closed frontier models still lead, but the gap at the second tier has closed materially. This matters for teams deciding whether to pay for API access or run their own weights, because the capability argument for the closed middle tier is getting thinner. (r/LocalLLaMA)
AI deepfakes of celebrities are spreading on Instagram with no clear accountability path. The Verge documented a pattern of AI-generated images impersonating celebrities, including a fake post attributed to actress Mia Goth that circulated widely after her divorce filing. The images are convincing enough to pass casual inspection and are being used to drive engagement on accounts that have no connection to the people depicted. The piece notes that neither platforms nor AI companies are absorbing the cleanup costs when these images cause reputational harm. The targets are instead being encouraged to adopt the same tools as a defensive measure. (Wired)
The thread
Serious models, local hardware, no cloud
Three separate releases this week, Meta's Muse Spark Open with Apple MLX support, NVIDIA's Nemotron 3.5 Super VL fitting a 120B model on one machine, and the Bolt 74B targeting 24GB consumer GPUs, all point at the same shift: the assumption that capable models require cloud infrastructure is being retired one release at a time. For people building products, this means on-device inference is no longer a constraint to work around but a design choice to make deliberately.
On our radar
- NVIDIA's Nemotron 3.5 Bolt 74B is a vision-language model designed to run on 24GB of local VRAM using native 2-bit quantization, per a Hugging Face release this week.
- Ternary Bonsai 2 models (2B, 4B, 9B) are now on Hugging Face, with the 2B running entirely in-browser via WebGPU at up to 500 tokens per second on an M4 Max.
- ALoDLM 8B, a looped diffusion language model, claims roughly 3x inference speed over its Qwen3-8B base with better benchmark scores, according to a r/LocalLLaMA post.
- Alibaba's Qwen team released BlenderWorld, a benchmark measuring how well visual agents can build 3D scenes in Blender from real-world image references.
- CopilotKit released CLiF, a continual learning platform that converts agent traces and user actions into fine-tuning data and evals for teams shipping agents at scale.
- A new arXiv paper introduces RealtimeBench, 180 tasks across six domains designed to test agents under live-clock conditions where a correct action arriving late counts as a failure.
- Researchers published a framework for representing timing, ordering, and persistence requirements in text-to-video prompts as formal specifications, addressing a known gap where models generate the right content in the wrong order.
- A separate arXiv paper examines what to do when benchmarks saturate, arguing that once several models approach perfect scores a benchmark loses its value for safety cases and frontier policy.
AI worth acting on, in your inbox
Get AI Weekly every Friday: the AI news, tools and tactics that matter for marketers, sellers and creators. Two minutes, with audio.
You can change these choices or unsubscribe at any time. Privacy Policy