The Archive

Integer-exact MXFP4 kernel optimization runs 4-bit LLM weights on INT8 matrix units (Apple M5 GPUs) via single INT8 GEMM.

The new Muse Spark Open AI model can work on M5 Ultra Mac Studios. | Photo: Amelia Holowaty Krales / The Verge Meta announced the Muse Spark Open AI model today, claiming that it's the "most capable US open-weight model to date." But the company also says that it's the "the first model in its class" that can "run on your desktop using two Apple M5 Ultra Mac Studios with the latest MLX framework." Meta and Apple, typically rivals, worked together on the launch and are publicly supporting each other. "Muse Spark Open - weights releasing today - runs great on new Mac Studios thanks to work with ...

Tool: CORS Chat I built this today ( with GPT-5.6-Sol xhigh ) to help test Qwen 3.8 27B running in LM Studio on both my M5 MacBook Pro and an NVIDIA DGX Spark. It provides a web UI for exercising an OpenAI-Responses-compatible chat endpoint. I've tried it against LM Studio with the --cors option and OpenRouter, and both work fine. Conversations are persisted in the browser and can be exported as copy-pasted JSON. One fun detail is that it notices SVG images that are being generated and progressively renders them in the chat while the tokens are still streaming in. Tags: svg , ai , generative-...

PipeNetwork/minimax-h3-mlx MiniMax released MiniMax-H3 two days ago - they describe it as a "a general-purpose, omni-modal generative system", which in practice means it accepts text, images, audio and video and can use them to generate up to 15 second video clips with audio included. This Python package ports it to MLX for running on Apple Silicon. I got it running on my M5 Max MacBook Pro. I cloned the repo and ran the model like this: # First download the models uvx --from huggingface_hub hf download MiniMaxAI/MiniMax-H3 \ --include 'FL2VA/*' --exclude 'FL2VA/transformer/*' uvx --from hugg...

MiniCPM5-1B released on HuggingFace: 1B-parameter model from CPM team, likely competitive efficiency benchmark for edge deployment.

Benchmarking study comparing M5 Macs, DGX Spark, Strix Halo, and RTX 6000 on inference speed; memory bandwidth correlates with tokens/second performance.

Anthropic's Mythos Preview enabled discovery of first public macOS kernel memory corruption exploit on Apple M5 in five days, defeating Apple's five-year MIE defense.

Researchers used Mythos Preview to find the first public macOS kernel memory corruption exploit on Apple's M5 silicon, they give a glimpse into Mythos say it’s really powerful. Apple spent five years and an estimated several billion dollars building Memory Integrity Enforcement (MIE), the hardware-assisted memory safety system built around ARM's MTE. It was the flagship security feature of the M5 and A19, designed specifically to kill the entire memory corruption bug class. Researchers from Calif built a working exploit in five days. According to Apple's own research, MIE disrupts every pu...

Mythos Preview LLM helped develop macOS kernel exploit for Apple M5 in 5 days, demonstrating AI-assisted security vulnerability discovery.

Apple discontinues 256GB M3 Ultra Mac Studio config; Reddit speculation about M5 Ultra memory trends.

Reddit discussion: RTX 5090 vs M5 Max 128GB for local Qwen3.6 27B agentic development—tradeoffs between speed and memory.

MTPLX inference engine achieves 2.24× throughput speedup for MTP-equipped models on Apple Silicon M5 Max via rejection sampling.

Discussion on whether to upgrade Mac hardware for running Qwen models locally as performance gap to Claude Opus narrows.