Releases·Tool Release
You can now run Laya Decision models locally on just 4GB RAM! 🔥 Works on CPU, Mac, Windows, Linux and GPU setups. Serve Laya through a Jev-compatible API via Unsloth Desktop. GitHub: https://t.co/a
Unsloth announced that Laya Decision models can now run locally on machines with as little as 4GB RAM. The setup works across CPU, Mac, Windows, Linux, and GPU, and serves the models through a Jev-compatible API via Unsloth Desktop. This lowers the hardware barrier for running these models to consumer-grade machines.
1727 engagement2 sourcesMon, Sep 28, 2026, 03:22 PM
AI Overview
- Runs on CPU, Mac, Windows, Linux and GPU setups, serving Laya via a Jev-compatible API through Unsloth Desktop with GitHub and guide links posted 2026-09-28
Related
Releases·Tool Releasefeatured
Unsloth releases Unsloth Desktop, an open-source local app for running and training AI models
Unsloth released Unsloth Desktop, the first desktop app to run and train AI models locally, available on Windows, macOS, and Linux. The open-source app supports MLX, GGUF, diffusion models, and connects Claude Code and Codex to local LLMs, with claims of 2x faster training and 70% less VRAM usage.
Unsloth released Unsloth Desktop, the first desktop app to run and train AI models locally, available on Windows, macOS, and Linux. The open-source app supports MLX, GGUF, diffusion models, and connects Claude Code and Codex to local LLMs, with claims of 2x faster training and 70% less VRAM usage.
Updated Thu, Aug 13, 2026, 03:21 PM — v0.1.702-beta update adds tool calling for external providers, tunable VRAM, and 10% faster inference.
1301.6k engagement5 sourcesreddit, hackernews, githubTue, Aug 11, 2026, 03:31 PM
Releases·Tool Release
DaragonTech releases LibLayaX: run the Laya AI decision model in apps with no server or Python
A developer released four MIT-licensed open-source projects (LibLayaX, RLaya, LLaya, DLaya) that let applications call the Laya yes/no decision model directly on CPU or GPU with no server or Python. Built on Lars Karlslund's laya.cpp port of Nandakishor Mukkunnoth's Laya model, the code was written by Claude in about 32 hours.
A developer released four MIT-licensed open-source projects (LibLayaX, RLaya, LLaya, DLaya) that let applications call the Laya yes/no decision model directly on CPU or GPU with no server or Python. Built on Lars Karlslund's laya.cpp port of Nandakishor Mukkunnoth's Laya model, the code was written by Claude in about 32 hours.
9 engagement1 sourceredditSat, Oct 3, 2026, 12:09 AM
Social·Community
Qwen3.8-27B 4-bit GGUF runs interactive volcano simulation in Unsloth Desktop
A user shared a 4-bit Qwen3.8-27B GGUF model generating an interactive volcano simulation with detailed physics in Unsloth Desktop, inviting others to share their results. The post highlights the model's capability for complex, multi-system simulation tasks on consumer hardware.
A user shared a 4-bit Qwen3.8-27B GGUF model generating an interactive volcano simulation with detailed physics in Unsloth Desktop, inviting others to share their results. The post highlights the model's capability for complex, multi-system simulation tasks on consumer hardware.
959 engagement1 sourcexFri, Aug 14, 2026, 07:20 PM
Products·launched
Pure WASM 4-bit LLM inference engine for browser, no GPU or server
A WebAssembly-based inference engine that runs a 350M-parameter LiquidAI LFM 2.5 model entirely in the browser with 4-bit quantization. It requires no GPU, no server, and no network at inference time, enabling private on-device AI chat for users without powerful hardware.
A WebAssembly-based inference engine that runs a 350M-parameter LiquidAI LFM 2.5 model entirely in the browser with 4-bit quantization. It requires no GPU, no server, and no network at inference time, enabling private on-device AI chat for users without powerful hardware.
4 engagement1 sourceredditWed, Jul 15, 2026, 02:28 AM
Releases·Tool Release
Unsloth releases Auto Compaction and LAN Remote Access in latest update
Unsloth merged 200+ PRs into its unslothai/unsloth repository, adding experimental Auto Compaction for extended chats, preview Remote & LAN Access without Cloudflare links, and faster chat performance. The update also supports custom llama.cpp builds and introduces Unsloth Dynamic v3.0.
Unsloth merged 200+ PRs into its unslothai/unsloth repository, adding experimental Auto Compaction for extended chats, preview Remote & LAN Access without Cloudflare links, and faster chat performance. The update also supports custom llama.cpp builds and introduces Unsloth Dynamic v3.0.
6 engagement2 sourcesgithubThu, Aug 20, 2026, 04:58 PM