Ollama published v0.34.1, a patch release updating its MLX runner and llama.cpp backends. Changes focus on memory handling: the mlxrunner now evicts prefix cache snapshots and waits for evicted runners and free system memory before loading the next model. The release also raises the token repeat limit to 100 and fixes a ChatGPT model selector spacing bug in the app.
Ollama released v0.34.3, making GET /api/show advertise each model's thinking levels and default, using glm-5.3-flash:cloud as the example. The release also adds MLX-based Apple Silicon support for Nemotron H vision models and fixes macOS window reopening.
Ollama released v0.34.3, making GET /api/show advertise each model's thinking levels and default, using glm-5.3-flash:cloud as the example. The release also adds MLX-based Apple Silicon support for Nemotron H vision models and fixes macOS window reopening.
superfluid is a local server daemon that fronts llama.cpp and MLX models behind Ollama-, OpenAI-, and Anthropic-compatible APIs so existing clients like Open WebUI keep working. It targets home-lab users running local models, addressing crash-lost conversations, chat latency when long agent prefills occupy the queue, and accidental exposure as an open inference endpoint.
superfluid is a local server daemon that fronts llama.cpp and MLX models behind Ollama-, OpenAI-, and Anthropic-compatible APIs so existing clients like Open WebUI keep working. It targets home-lab users running local models, addressing crash-lost conversations, chat latency when long agent prefills occupy the queue, and accidental exposure as an open inference endpoint.
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
Ollama released three versions in a week: v0.33.0 (Aug 21), v0.33.1 (Aug 26), and v0.33.2 (Aug 27). The updates add a Claude desktop app, MLX runner improvements including structured output support and Qwen3.8 Flash Next support, plus app and proxy fixes. Practitioners running local models on Mac benefit from Metal GPU timeout fixes and faster structured output.
Ollama released three versions in a week: v0.33.0 (Aug 21), v0.33.1 (Aug 26), and v0.33.2 (Aug 27). The updates add a Claude desktop app, MLX runner improvements including structured output support and Qwen3.8 Flash Next support, plus app and proxy fixes. Practitioners running local models on Mac benefit from Metal GPU timeout fixes and faster structured output.
A Reddit post by mensaprodigy announces three Qwen3.8-Flash-Next REAP builds for Apple Silicon, benchmarked on an M4 Max against Jundot's oQ4e MTP community package. All builds are qwen4_exp derivatives with 48 transformer layers, top-10 routing, a retained 512-expert native MTP predictor, and 262k configured context. The post gives coding scores, throughput, and memory footprints for each build, plus guidance on which to pick.
A Reddit post by mensaprodigy announces three Qwen3.8-Flash-Next REAP builds for Apple Silicon, benchmarked on an M4 Max against Jundot's oQ4e MTP community package. All builds are qwen4_exp derivatives with 48 transformer layers, top-10 routing, a retained 512-expert native MTP predictor, and 262k configured context. The post gives coding scores, throughput, and memory footprints for each build, plus guidance on which to pick.