Releases·Tool Release
KaozKit: sandboxed LLM agents in JS, fully on-device on Apple Silicon (MLX / Apple Intelligence / Ollama), MIT
Sebastien Burel released KaozKit, an MIT-licensed Swift library that runs JavaScript LLM agents inside Mac apps fully on-device. Agents execute in XS, a microcontroller-oriented JS engine, sandboxed so they see only host-provided functions. It supports MLX, Apple Intelligence's on-device model, Ollama, and LM Studio.
1 engagement1 sourceThu, Sep 17, 2026, 08:36 AM
AI Overview
- KaozKit runs ~ten-line JS agents inside XS, a microcontroller JavaScript engine, with one isolated engine per agent at near-zero cost — no Node or Python shipped
- Agents get no fetch, fs, or ambient access — only host-provided functions, per-folder file authorization, opt-in allow-listed actions, and no API keys on the JS side
- XS heap snapshots persist resident agents' state, conversation, and pending timers across restarts with no serialization code
- Providers: MLX with Hugging Face model management, Apple Intelligence's keyless on-device model, plus Ollama and LM Studio; README demo audits the Downloads folder with zero config
Related
Releases·Tool Release
Moka Chat gives Ollama models MCP tools via one npx command, with an inspector showing every tool call
A developer released Moka, a free, MIT-licensed local sandbox for testing prompts and MCP servers visually. It runs via 'npx @mokalabs/sandbox' with zero config, auto-detects running Ollama instances, and includes an inspector exposing raw JSON-RPC traffic, tokens, and latency. Developers can test tool calls and streaming, compare models side by side, and export working LangGraph Python scripts directly.
A developer released Moka, a free, MIT-licensed local sandbox for testing prompts and MCP servers visually. It runs via 'npx @mokalabs/sandbox' with zero config, auto-detects running Ollama instances, and includes an inspector exposing raw JSON-RPC traffic, tokens, and latency. Developers can test tool calls and streaming, compare models side by side, and export working LangGraph Python scripts directly.
13017 engagement4 sourcesredditSat, Oct 3, 2026, 03:37 AM
Products·launched
Pocket AI Lab - open source iOS app for running LLMs fully on-device
Pocket AI Lab is a free, MIT-licensed iOS app that runs LLMs entirely on the iPhone with no cloud or account. Users paste a Hugging Face model link and the app detects the format to start chatting. It targets people who want to quickly try newly released open models locally on-device.
Pocket AI Lab is a free, MIT-licensed iOS app that runs LLMs entirely on the iPhone with no cloud or account. Users paste a Hugging Face model link and the app detects the format to start chatting. It targets people who want to quickly try newly released open models locally on-device.
11 engagement1 sourceredditThu, Sep 10, 2026, 11:00 AM
Products·launched
Macaw: On-device AI agent for macOS with 97 tools
Macaw is a private AI model that runs entirely on a Mac and controls it via 97 verified tools for mail, files, calendar, music, system settings, and multi-step chains. It uses a 2.7B LFM2.5 fine-tune with MLX 4-bit quantization, requires no cloud, and is available now with open weights and MIT code.
Macaw is a private AI model that runs entirely on a Mac and controls it via 97 verified tools for mail, files, calendar, music, system settings, and multi-step chains. It uses a 2.7B LFM2.5 fine-tune with MLX 4-bit quantization, requires no cloud, and is available now with open weights and MIT code.
27 engagement1 sourcegithubWed, Aug 5, 2026, 06:50 PM
Releases·Tool Release
Local-llmup package lets users install or switch local LLM runtimes
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
A developer released Local-llmup, a package for managing local LLM installations and switching between runtimes such as Ollama, llama.cpp, MLX, and LM Studio. The tool aims to simplify runtime management for local AI workflows.
74 engagement2 sourcesredditMon, Aug 10, 2026, 07:22 AM
Releases·Tool Release
ollama releases v0.34.1 with MLX memory and cache fixes
Ollama published v0.34.1, a patch release updating its MLX runner and llama.cpp backends. Changes focus on memory handling: the mlxrunner now evicts prefix cache snapshots and waits for evicted runners and free system memory before loading the next model. The release also raises the token repeat limit to 100 and fixes a ChatGPT model selector spacing bug in the app.
Ollama published v0.34.1, a patch release updating its MLX runner and llama.cpp backends. Changes focus on memory handling: the mlxrunner now evicts prefix cache snapshots and waits for evicted runners and free system memory before loading the next model. The release also raises the token repeat limit to 100 and fixes a ChatGPT model selector spacing bug in the app.
14 engagement1 sourcegithubMon, Sep 14, 2026, 10:14 PM