AI Engineering Digest

MiniMax opens M3.1 Flash, and a Studio can just hold it.

Friday, October 23, 2026
Issue 45 · sourced briefing
Sources: MiniMax · MLX · Ollama · Gradium · OpenAI · Anthropic · Google Cloud · AWS · llama.cpp
Lead Story

MiniMax put M3.1 Flash’s weights on Hugging Face overnight, and by morning there was a 3-bit MLX build that fits a 256 GB Mac Studio

The weights we’ve been waiting on since MiniMax’s Oct 19 release notes appeared late Thursday night (Oct 22 ET). Within hours mlx-lm merged support for the original checkpoint and the MLX community posted text-only builds. The license lets you use it, but it is not open source.

M3.1 Flash is a large mixture-of-experts model aimed at coding, agent work, computer use, and security tasks. It has about 428B parameters in total, about 23B active per token, takes text, images, and video, and MiniMax says it handles up to 1M tokens of context. MiniMax trained it with quantization built in, so the official files are already compressed, and they include a small draft model for faster decoding. MiniMax’s benchmark table compares it with frontier models on coding and agent tests. By MiniMax’s own count it still trails Claude Opus 5 on Terminal-Bench 4.0 (38.1 vs 51.8). Every number is MiniMax’s (vendor-reported), and the card warns that third-party quantized builds may score differently.

On a Mac: the MLX community’s 3-bit text build is about 187 GB and is the realistic fit for a 256 GB Studio. The 4-bit build keeps MiniMax’s original format but needs about 249 GB, which leaves almost nothing for macOS or context. Both drop the vision part for now. mlx-lm’s maintainers merged support for loading MiniMax’s original files early this morning, but it isn’t in a tagged release yet. Unsloth’s GGUF repository for llama.cpp was still empty at our check, and Ollama offers the model only in its cloud.

Why it matters: this is a frontier-scale agent model that one 256 GB Mac can hold, and MLX support arrived the same night the weights did. The 3-bit build leaves roughly 70 GB for macOS and context.

Cautions. The license is the MiniMax Community License, not an open-source license. Its opening grant covers non-commercial use. Commercial use, which explicitly includes hosted APIs and fine-tuned derivatives, requires a “Built with MiniMax M3.1-Flash” credit and a notice to MiniMax, or written approval if your product earns more than $20 million a year. Military use is banned. Ollama’s cloud listing says 976K context where the card says 1M, and one community build’s card overstates the license by saying all commercial use needs prior approval. The only Mac-relevant speed figure, 23.8 tokens per second on the full original checkpoint, comes from one test run in the mlx-lm pull request, with no hardware named.

Sources: Model card · License · mlx-lm #2003 · MLX 3-bit · MLX 4-bit · Ollama

By the Numbers
428B / 23B
Total vs active parameters per token · MiniMax model card
~187 GB
Peak memory for the MLX 3-bit text build, the one that fits a 256 GB Studio · mlx-community card
~249 GB
Peak memory for the MLX 4-bit build in MiniMax’s native format · mlx-community card
$20M
Yearly revenue above which commercial use needs MiniMax’s written approval · MiniMax Community License

Quiet lanes

No new vLLM advisories since the Oct 20 batch · none for llama.cpp / Ollama / MLX / SGLang / mlx-lm · MLX 0.32.4, mlx-lm 0.32.2, vLLM 0.32.0, SGLang 0.5.22 still latest · PyTorch 2.15 final not on PyPI · Apple ML Research since Oct 14 · xAI docs since Oct 14 · DeepSeek since Oct 17 · Tencent newsroom: no OSS model post · php2shell CVEs still not on CISA KEV · no new NIST AI items


Commentary

Wednesday morning through Friday morning (Oct 21–23 ET). ASTGL / Fraser takes, sourced.

The 256 GB line: 3-bit fits, native 4-bit doesn’t

We’ve had MiniMax M3.1 Flash on Watch for three issues. The weights finally showed up around midnight, and the MLX community had builds up before most of us were awake. The useful detail for Studio owners is simple. The 4-bit build keeps MiniMax’s original format, but at about 249 GB peak it leaves a 256 GB machine with no room for anything else. The 3-bit build, at about 187 GB, is the one to try. My take: download the 3-bit build this weekend and test it on agent tasks you already know the answers to, because every benchmark so far is MiniMax’s. And read the license before you build anything on it. “Open weights” is accurate. “Open source” isn’t. If this ends up in a paid product, you owe MiniMax a credit line and an email.

Sources: Model card · License · MLX 3-bit · MLX 4-bit

Picking your data processor is now a menu option

Claude has been on Google Cloud for a while, run by Google. As of Thursday you can also buy Claude through Google Cloud with Anthropic running it. The price is the same and the billing is Google’s either way. The difference is who processes your data and when you get new features. With Anthropic managing it, you get things like Managed Agents and skills on day one, under Anthropic’s terms. With Google managing it, you keep Google as processor, plus VPC Service Controls, customer-managed keys, and regional data residency, but new features arrive later. My take: this is a compliance decision, not a model decision, so put your security and legal people in the room before engineering picks one. One gotcha from Anthropic’s setup docs: the Anthropic-managed option creates a brand-new Anthropic organization, separate from any you already have. Existing discounts don’t apply to past usage, so talk to your account rep first.

Sources: Google Cloud (Oct 22) · Claude release notes (Oct 22) · Setup docs

Agent Skills goes neutral, and the security guidance is the part to watch

Anthropic handed Agent Skills, the SKILL.md folder format for teaching an agent a task, to the Linux Foundation’s Agentic AI Foundation. That’s the same home MCP went to. Anthropic says more than 70 agent platforms support the format, including ChatGPT, Cursor, GitHub Copilot, and VS Code, and that a million skills have been published (Anthropic’s figure). My take: neutral ownership helps, because a format controlled by one vendor is a risk to build on. But the line I care about is on the roadmap: security guidance for writing and installing skills. A skill is instructions plus scripts that an agent will follow and run. That makes installing a stranger’s skill a supply-chain decision, and today there is no standard way to vet one. Until that guidance exists, read every skill before you install it, the same way you’d read a shell script piped from the internet.

Sources: Anthropic (Oct 22) · agentskills on GitHub

Yes-or-no answers got their own cheap endpoint, in the cloud and on your Mac

On the same day, OpenAI made its Decisions API generally available and Ollama shipped d3, a local family of models built for the same kind of job. Both take a piece of text, data, or an image and return a bounded answer: yes or no, one choice from a list, or a score. OpenAI charges $0.10 per million input tokens with no output-token charge, and says it is up to 10 times faster than asking the same model through its general API (OpenAI’s claim). My take: much of what agents do all day is routing, triage, and gating, and none of that needs a paragraph of reasoning back. Pulling those calls into a purpose-built endpoint is cheaper and easier to test. If the data can’t leave your network, try d3 locally first. If it can, Decisions is a cheap way to run thousands of these.

Sources: OpenAI (Oct 22) · OpenAI changelog · Ollama v0.40.9

Fewer subagents, stronger sandboxes

Two posts on Thursday point the same way. Anthropic’s applied AI team says many enterprise agents improved after folding their routers, planners, and domain subagents back into one main loop. In their words, “one clear system prompt, 4-5 thin data tools, and firm output guardrails” covered most of the use case. Google, meanwhile, previewed Agent Compute Engine: lightweight virtual machines for agents with snapshot and restore and short-lived credentials. It isn’t available yet; Google says the preview comes “in the coming months.” My take: the multi-agent diagrams from last year are getting simpler, and the hard problems are moving to the edges, meaning what the agent is allowed to touch and how quickly you can undo it. If your agent has five subagents, try collapsing them into one loop with fewer tools, and compare quality and cost.

Sources: Claude blog (Oct 22) · Google Cloud (Oct 22)


Today’s Stories
Local · On-device

Ollama 0.40.9 gives local models a voice and adds small models built for yes-or-no decisions

Oct 22: Ollama now does text-to-speech on Apple Silicon with Gradium’s Phonon models. ollama run can read a reply aloud as it is generated, and apps can stream audio through an OpenAI-compatible speech endpoint. The default English voice model is Apache 2.0; the German, French, Spanish, Portuguese, and multilingual models are licensed for non-commercial use only. The release also adds d3, decision models in four sizes that classify, answer yes or no, or score options with probabilities. Flint now runs on Linux and Windows too, and streaming requests report errors instead of stopping silently.

Sources: Ollama v0.40.9 · Phonon tags · Gradium on HF

Frontier

OpenAI’s Decisions API is generally available, with input-only pricing and twice the questions per request

Oct 22: The API for bounded answers (yes or no, a choice, or a score) is out of beta on GPT-6 Luna. You can now ask up to 400 questions per request instead of 200, pass structured data directly, include images in individual questions, and cache shared input for a discount. OpenAI lists $0.10 per million input tokens and no charge for output. US and EU data residency and zero data retention are available for eligible customers. Speed and cost wins quoted from Box, Datadog, Ramp, Sierra, and Speak are OpenAI-selected (vendor-reported).

Sources: OpenAI · Changelog

Enterprise

You can now buy Claude through Google Cloud with Anthropic running it, alongside the Google-run option

Oct 22: The new Anthropic-managed option is the Claude API itself, reached through your Google Cloud project. Google Cloud IAM controls access and Marketplace handles billing. Claude Platform features such as Managed Agents, skills, and code execution arrive on day one, and fast mode for Opus 5.5 is included. Anthropic is the data processor under its own terms. The Google-managed option keeps Google as processor, with VPC Service Controls, customer-managed keys, and US/EU/APAC residency, but new features arrive later. Pricing is the same for both. Setup creates a new Anthropic organization separate from any you already have.

Sources: Google Cloud · Claude docs

Enterprise · OSS

Anthropic donates Agent Skills to the Linux Foundation’s Agentic AI Foundation

Oct 22: The SKILL.md format for packaging agent instructions and scripts moves to the same foundation that holds MCP, along with its name, GitHub organization, and agentskills.io. Engineers from Anthropic, Google, OpenAI, and other companies will maintain it as individuals. The proposed roadmap starts with versioned releases, a formal proposal process, and security guidance for people who write and install skills. Anthropic says more than 70 agent platforms support the format, with a million skills published and nearly 280 million installs (Anthropic’s figures).

Sources: Anthropic · agentskills.io

Security

AWS Continuum for code vulnerabilities is generally available: it tests whether a bug is exploitable, then opens the fix as a pull request

Oct 22: Continuum maps your code (from GitHub or S3) together with your AWS setup, so it can judge whether a finding is reachable. It tries reproducible exploits in an isolated sandbox, ranks what’s left by business impact, and proposes a patch, dependency upgrade, or config change as a pull request, with the proof and blast radius attached. A person approves every fix for now. AWS says you’ll be able to let it act on its own for trusted kinds of fixes later. It arrives a day after Anthropic made Claude Security a continuous scanner.

Sources: AWS News Blog · What’s New

ML practice

SageMaker now lets you write your own fine-tuning loop without managing GPUs

Oct 22: New training session APIs give you a live, stateful session on a hosted model. Your Python code calls a forward-and-backward pass, an optimizer step, or sampling, so you can write SFT, DPO, a custom RL reward, or a new loss yourself instead of picking a managed recipe. Checkpoint and resume are built in. Billing is per token processed, so work on your own machine, like scoring rewards, isn’t billed as GPU time. If you’ve wanted to try RL on a small model without renting a cluster, this is a new low-ops option. It’s a cloud service, not a Mac recipe.

Sources: AWS ML blog · What’s New


Other news in AI

OpenAI announced a safety partnership with Poland’s NASK research institute. OpenAI


Signal tables

Model & runtime releases

ItemDateBadge
MiniMax M3.1 Flash weights (428B / 23B active, MiniMax Community License)Oct 22Open
mlx-lm #2003: load original MiniMax M3.1 checkpoint (merged; not yet released)Oct 23Open
mlx-community MiniMax M3.1 Flash Text 3-bit (~187 GB) / 4-bit (~249 GB) + oQ buildsOct 23Open
Ollama v0.40.9: Phonon speech, d3 decision models, Flint on Linux/WindowsOct 22Voice
Gradium Phonon 31M English TTS (Apache 2.0); 40M variants CC BY-NCOct 19–22On-device
llama.cpp b11833–b11836: DFlash2 probabilistic drafts, Nemotron-3.5-Embed fix, MiniCPM-OCROct 22–23Open
Tencent WeVisOne-VL 2B / 4B vision models (Apache 2.0)Oct 22Open
AI2 OlmoEarth v1.3 Earth-observation embeddingsOct 22Open
OpenAI Decisions API GA (GPT-6 Luna, 400 questions/request)Oct 22Cloud
Claude Models on Google Cloud (Anthropic managed)Oct 22Cloud
SageMaker AI training session APIsOct 22Cloud
AgentCore Gateway: Bedrock InvokeModel + model fallbackOct 22Cloud
NVIDIA Minerva (AIOps for AI factories)Oct 22Cloud

Security / policy / access

ItemDateBadge
AWS Continuum for code vulnerabilities GA (sandbox-validated fixes as PRs)Oct 22Active
Agent Skills donated to the Agentic AI Foundation (Linux Foundation)Oct 22Active
MiniMax Community License: non-commercial grant; credit + notice for commercial use; approval above $20M revenueOct 22Watch
Google Agent Compute Engine (agent microVMs); preview “in the coming months”Oct 22Watch
php2shell CVEs still not on CISA KEV (catalog 2026.10.21)Oct 23Watch
No new vLLM advisories since the Oct 20 batch; none for llama.cpp / Ollama / MLX / SGLangOct 22–23Quiet

Industry shorts

Critical

Before you ship anything built on MiniMax M3.1 Flash, read its license. Commercial use, including a hosted API or a fine-tune, needs a visible credit and a notice to MiniMax. If you use Ollama’s non-English Phonon voices, check the license: they are non-commercial only.

Watch

MiniMax M3.1 Flash in a tagged mlx-lm release, with vision support; GGUF builds for llama.cpp (Unsloth’s repo was empty at our check); and a local Ollama tag. Google Agent Compute Engine’s preview date. Still pending: Nemotron 3.5 Bolt E4B (NVIDIA said Oct 23; not on Hugging Face at our check), PyTorch 2.15 final, Flint in mlx-lm, and OpenAI’s gateway approvals ahead of Nov 20.

Opportunity

Nobody has published MiniMax M3.1 Flash numbers on a named Mac. Tokens per second and real coding-agent results for the 3-bit MLX build on an M3 Ultra, set against MiniMax’s own table, would be the first.


Try this

Run MiniMax M3.1 Flash on a 256 GB Studio

Use the 3-bit text build, which peaks around 187 GB: pip install -U mlx-lm, then mlx_lm.generate --model mlx-community/MiniMax-M3.1-Flash-Text-3bit --temp 1.0 --top-p 0.95 -p "Explain this stack trace: …" -m 2048. The download is about 187 GB, so check your disk first. Close other big apps, and keep prompts short until you know how much context fits. Text only for now.

Make Ollama talk

Update to Ollama 0.40.9, then run ollama run phonon "Hello from Ollama.". The default phonon tag is Gradium’s 31M English model, licensed Apache 2.0, at about 104 MB. Apps can stream the same voice through the OpenAI-compatible /v1/audio/speech endpoint. Skip the de, fr, es, pt, and multilingual tags for anything commercial.

Try a local yes-or-no model

Ollama’s own example: ollama run d3 "A customer says their card was charged twice." --ask "Is this a billing issue?". Run a few dozen of your real support or triage messages through it and compare its calls against your own before you put it in front of an agent.