A ternary-quantized 30B model now runs 368K context on a 12 GB GPU. A community release of Ternary Nemotron 30B-A3B, quantized to 1.58 bits per weight, fits on a single 12 GB card and delivers 172 tokens per second decode with a prefill speed above 7,000 tokens per second. The 368,000-token context window is the headline number: most consumer GPU setups top out well below that. It runs on both stock llama.cpp and the PrismML fork, distributed as a single GGUF file. The gap between what fits on a research cluster and what fits on a gaming card keeps closing. (r/LocalLLaMA)
Anthropic Files S-1, Reveals Growth and Staggering Losses
Good morning. Anthropic filed its S-1 today, which means the company that spent years explaining why AI might kill everyone now has to explain that to the SEC. The filing drops revenue figures, loss figures, and a governance structure designed to keep the founders in control regardless of what public shareholders think. Meanwhile, a 30-billion-parameter model that runs on a 12 GB GPU cleared 368,000 tokens of context this weekend, which is the kind of thing that would have been a research headline two years ago and is now a Reddit post.
Today's reading time is 5 minutes.
Anthropic has operated as a private company since 2021, raising money from Amazon and Google while publishing safety research and building Claude into a serious enterprise product.
Driving the news: Anthropic filed its S-1 prospectus with the SEC on Monday, targeting a Nasdaq listing under the ticker ANT. The filing discloses explosive revenue growth over the past year alongside steep and widening net losses, reflecting the cost of training and serving frontier models at scale. The company plans a dual-class share structure that preserves founder control after the IPO, a common arrangement in tech but one that sits awkwardly against Anthropic's stated mission of keeping AI development accountable.
- The prospectus names Claude Mythos as the company's current flagship model.
- Anthropic beats OpenAI to a public filing, though OpenAI has discussed its own eventual listing.
Zoom in: Anthropic was founded in 2021 by former OpenAI researchers, including Dario and Daniela Amodei, explicitly around the argument that frontier AI needed a safety-focused lab at the frontier. That pitch attracted billions from Amazon and Google. Going public forces a different kind of accountability: quarterly earnings calls, institutional shareholders, and a prospectus that has to describe existential AI risk as a material business risk in the same breath as competition from other model providers.
- Amazon has committed multi-billion dollar cloud and investment ties to Anthropic, making it both a customer and a stakeholder in the IPO.
- The governance structure is designed to insulate the safety mission from shareholder pressure, though how that holds under public market scrutiny is untested.
Why it matters: For teams building on Claude's API, an IPO changes the incentive structure around the product. Public companies face pressure to grow revenue faster and cut costs, which historically means API pricing and model access policies shift. The filing also forces Anthropic to disclose competitive risks it previously kept private, giving developers a clearer picture of how the company sees its own position.
Bottom line: Anthropic spent five years arguing that AI safety and commercial success could coexist; the S-1 is the first document where it has to prove that to people who can sell the stock.
TechCrunch ↗Also happening
Hugging Face released Carbon-X, a 14.8B model that reads raw DNA and answers in English. Carbon-X is built on Qwen3-14B and fine-tuned to treat DNA sequences as a first-class input alongside natural language, letting researchers ask questions about genetic data in plain text and get plain-text answers. It scores an average of 66.7% across five DNA benchmarks. The model is released under Apache 2.0, meaning it can be used commercially without restriction. Bioinformatics workflows that previously required separate specialized tools for sequence analysis and text generation can now route both through one model. (MarkTechPost)
Anthropic launched a free vulnerability scanner for critical open-source projects. OSS Scanner is an opt-in service that runs Anthropic's strongest models against enrolled open-source codebases and sends vulnerability reports directly to maintainers, with no human review in the loop. The target is critical infrastructure projects that lack dedicated security teams. Reports go straight to maintainers, which keeps the disclosure chain short but also means no human catches a false positive before it lands. It uses Claude Mythos as the underlying model. (MarkTechPost)
Tsinghua researchers cut LLM agent costs 27.7% by repositioning cached context instead of summarizing it. AKV is an open-source serving system built on SGLang that treats the KV cache, the stored representation of prior conversation turns, as something to drop and reposition rather than compress into a summary. Across four agent benchmarks, average cost fell 27.7% compared to standard summarization approaches. The system is aimed at long-running agents that accumulate large histories, where summarization errors compound over time. It is available now under an open license. (MarkTechPost)
On our radar
- Fanatics tested an AI-powered outfit recommendation feature across roughly 30,000 MLB products and saw 10% higher engagement, per an OpenAI case study.
- AI agents named Jayden, Sam, and Zack are pitching editors on reported stories and investigative features, according to a Wired piece on automated journalism startups.
- Used RTX 3090 prices on eBay have climbed to around $1,500, roughly double what buyers paid in 2023, driven by local AI inference demand - a r/LocalLLaMA thread on a failed card captures the secondary market squeeze.
- A new arXiv paper models multi-turn jailbreaking as a Markov decision process, using multiple LLMs in sequence to progressively bypass safety filters - the approach outperforms single-turn red-teaming heuristics.
- Researchers studying LLM agents in multi-party negotiations found that knowing which party to trust does not reliably translate into reaching agreement, a gap they call the trust-agreement problem.
- An arXiv paper on agent authorization argues that durable agents need explicit recovery logic for cases where permissions change mid-task and the external outcome of a prior action is still uncertain.
- A Qwen3.8-Flash-Next community benchmark showed 900 tokens per second prefill and 30 tokens per second generation on a setup with 8 GB VRAM and 32 GB RAM, outperforming several larger models in the poster's tests.
AI worth acting on, in your inbox
Get AI Weekly every Friday: the AI news, tools and tactics that matter for marketers, sellers and creators. Two minutes, with audio.
You can change these choices or unsubscribe at any time. Privacy Policy