The Draw Things team opened a public beta of Local Code, a coding agent built on the Draw Things inference engine and distributed via TestFlight. It claims 1.2x-1.6x faster prefill than alternatives on Apple Silicon, with no sign-up required. The app ships as a sandboxed, self-contained package bundling common coding tools.
Bobcat is a local LLM inference engine optimized across the stack for consumer MacBooks on Apple Silicon. It runs models locally and claims to be the fastest way to run models like LFM, Qwen3.5, and Clef Flash on Mac. It targets Mac users who want fast local inference without cloud services.
Bobcat is a local LLM inference engine optimized across the stack for consumer MacBooks on Apple Silicon. It runs models locally and claims to be the fastest way to run models like LFM, Qwen3.5, and Clef Flash on Mac. It targets Mac users who want fast local inference without cloud services.
mlx-dspark, an MLX port of DeepSeek's DSpark speculative-decoding drafters, now supports Qwen3.8-27B via RadixArk's drafter, achieving up to ~3× speedups on Apple Silicon. Benchmarks on an M4 Pro show 2.45× mean speedup for 8-bit targets, with code runs hitting 3.18×.
mlx-dspark, an MLX port of DeepSeek's DSpark speculative-decoding drafters, now supports Qwen3.8-27B via RadixArk's drafter, achieving up to ~3× speedups on Apple Silicon. Benchmarks on an M4 Pro show 2.45× mean speedup for 8-bit targets, with code runs hitting 3.18×.
A Substack essay and Reddit discussions argue Apple is the smartest tech company in AI because near-frontier models run locally on a single Mac Studio, and multi-trillion-parameter frontier models run at 20+ tokens/sec on a small Thunderbolt-connected cluster, cheaper and more power-efficient than NVIDIA workstations. The posts frame this as an underappreciated advantage.
A Substack essay and Reddit discussions argue Apple is the smartest tech company in AI because near-frontier models run locally on a single Mac Studio, and multi-trillion-parameter frontier models run at 20+ tokens/sec on a small Thunderbolt-connected cluster, cheaper and more power-efficient than NVIDIA workstations. The posts frame this as an underappreciated advantage.
Zeno is a free agentic AI work tool that runs fully on a Mac, using a 4-bit quantized Qwen3.6-35B-A3B model. It works with local files, keeps data private, and has no usage bills or watermarks, making it a local alternative to cloud-based tools like Claude Cowork.
Zeno is a free agentic AI work tool that runs fully on a Mac, using a 4-bit quantized Qwen3.6-35B-A3B model. It works with local files, keeps data private, and has no usage bills or watermarks, making it a local alternative to cloud-based tools like Claude Cowork.
Vpipe is a lightweight C++/Metal runtime for Apple Silicon that runs LLMs, VLMs, image/video generation, ASR, quantization, and multimodal pipelines without PyTorch or MLX. The runtime package is only ~25MB, with a prebuilt Mac app available. A recent milestone shows MiniMax H3 video generation running on a 16GB base M5 MacBook Air.
Vpipe is a lightweight C++/Metal runtime for Apple Silicon that runs LLMs, VLMs, image/video generation, ASR, quantization, and multimodal pipelines without PyTorch or MLX. The runtime package is only ~25MB, with a prebuilt Mac app available. A recent milestone shows MiniMax H3 video generation running on a 16GB base M5 MacBook Air.