Releases·Tool Release
Eugene Plexus v0.1.0-alpha.2: open-source control plane for local inference seeks alpha testers, especially Mac users
A developer opened a public alpha of Eugene Plexus, an open-source control plane for managing local LLM inference across machines from a browser. It bundles model discovery and downloads, engine setup, model launching, and a gateway exposing OpenAI- and Anthropic-compatible endpoints. The alpha is at v0.1.0-alpha.2 with limited independent testing, and the author is recruiting testers, especially Mac users.
3 engagement1 sourceTue, Sep 22, 2026, 12:24 PM
AI Overview
- Eugene Plexus offers model discovery/downloads, engine setup, model launching, and a gateway with OpenAI- and Anthropic-compatible endpoints from one browser interface
- v0.1.0-alpha.2 runs on Windows, Linux, or Docker/NAS control planes connecting separate worker machines; llama.cpp/Metal path is unverified on physical Mac hardware
- MLX support is absent from this release but under development on a separate branch; installer at eugeneplexus.com, source at github.com/eugene-plexus/specs
- Developer seeks testers to verify instructions, first inference, app connections, and error clarity; asks reports to include OS, GPU/VRAM, and single- vs NAS setup
Entities
Related
Releases·Tool Release
Ollama ships v0.33.x releases with MLX runner updates and Qwen3.8 Flash Next support
Ollama released three versions in a week: v0.33.0 (Aug 21), v0.33.1 (Aug 26), and v0.33.2 (Aug 27). The updates add a Claude desktop app, MLX runner improvements including structured output support and Qwen3.8 Flash Next support, plus app and proxy fixes. Practitioners running local models on Mac benefit from Metal GPU timeout fixes and faster structured output.
Ollama released three versions in a week: v0.33.0 (Aug 21), v0.33.1 (Aug 26), and v0.33.2 (Aug 27). The updates add a Claude desktop app, MLX runner improvements including structured output support and Qwen3.8 Flash Next support, plus app and proxy fixes. Practitioners running local models on Mac benefit from Metal GPU timeout fixes and faster structured output.
Updated Wed, Sep 2, 2026, 12:11 AM — v0.33.2 released Aug 27 with dark mode restore, proxy catalog-change handling, and macOS handoff sync.
04036 engagement4 sourcesgithubFri, Aug 21, 2026, 10:52 PM
Releases·Tool Release
ollama releases v0.34.1 with MLX memory and cache fixes
Ollama published v0.34.1, a patch release updating its MLX runner and llama.cpp backends. Changes focus on memory handling: the mlxrunner now evicts prefix cache snapshots and waits for evicted runners and free system memory before loading the next model. The release also raises the token repeat limit to 100 and fixes a ChatGPT model selector spacing bug in the app.
Ollama published v0.34.1, a patch release updating its MLX runner and llama.cpp backends. Changes focus on memory handling: the mlxrunner now evicts prefix cache snapshots and waits for evicted runners and free system memory before loading the next model. The release also raises the token repeat limit to 100 and fixes a ChatGPT model selector spacing bug in the app.
14 engagement1 sourcegithubMon, Sep 14, 2026, 10:14 PM
Releases·Tool Release
llm-eyes tool lets any blind LLM see via tiny local VLM
A GitHub project called llm-eyes bolts a tiny vision-language model (Qwen3.5-0.8B) onto any machine as a local vision service, enabling text-only models like DeepSeek V4 Flash, Qwen, and Llama to caption images, watch webcams, or read video. It runs on Mac (MLX), PC+NVIDIA (llama.cpp), and DGX Spark, and exposes an OpenAI-compatible API.
A GitHub project called llm-eyes bolts a tiny vision-language model (Qwen3.5-0.8B) onto any machine as a local vision service, enabling text-only models like DeepSeek V4 Flash, Qwen, and Llama to caption images, watch webcams, or read video. It runs on Mac (MLX), PC+NVIDIA (llama.cpp), and DGX Spark, and exposes an OpenAI-compatible API.
23 engagement1 sourcegithubTue, Jul 7, 2026, 04:52 PM
Releases·Tool Release
Local-llmup package lets users install or switch local LLM runtimes
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
74 engagement2 sourcesredditMon, Aug 10, 2026, 07:22 AM
Social·Community
Qwen3.8-27B on M1 Max 32GB: MLX 15.8 tok/s vs llama.cpp 9.7 tok/s - but llama.cpp prefill is faster
A user benchmarked Qwen3.8-27B on an M1 Max Mac Studio with 32GB unified memory, comparing MLX and llama.cpp as local inference runtimes. MLX delivered higher decode throughput (15.8 tok/s vs 9.7 tok/s), while llama.cpp showed faster prefill. The results matter to practitioners choosing runtimes for memory-constrained Apple Silicon local LLM serving.
A user benchmarked Qwen3.8-27B on an M1 Max Mac Studio with 32GB unified memory, comparing MLX and llama.cpp as local inference runtimes. MLX delivered higher decode throughput (15.8 tok/s vs 9.7 tok/s), while llama.cpp showed faster prefill. The results matter to practitioners choosing runtimes for memory-constrained Apple Silicon local LLM serving.
4 engagement1 sourceredditMon, Sep 7, 2026, 06:36 PM