Releases·Tool Release
axem open sources Shaide, a K8s-native platform for multi-model LLM inference
axem co-founders open sourced Shaide, a Kubernetes-native platform for running multiple LLMs on self-hosted infrastructure. It targets the pain of scaling several models independently across GPU nodes and routing requests between replicas without an external cloud.
5 engagement2 sourcesTue, Sep 1, 2026, 01:40 PM
AI Overview
- Shaide handles simultaneous multi-model serving: independent scaling across GPU nodes, request routing between replicas, reproducible setup
- Built Kubernetes-native, aimed at teams avoiding reliance on external cloud services
- Released as open source on GitHub by axem co-founders, announced via Show HN
- Project grew incrementally from the difficulty of running several models concurrently, not from single-model serving
Entities
Related
Releases·Tool Release
Show HN: Modelship – an open source Ray-backed model cluster serving an OpenAI Responses API
A developer released Modelship, an open-source tool that spins up a Ray cluster and deploys models via loaders like vLLM, llama.cpp, and diffusers behind an OpenAI Responses-compatible API. It targets self-hosters and practitioners running multi-model setups on their own hardware.
A developer released Modelship, an open-source tool that spins up a Ray cluster and deploys models via loaders like vLLM, llama.cpp, and diffusers behind an OpenAI Responses-compatible API. It targets self-hosters and practitioners running multi-model setups on their own hardware.
1 engagement1 sourcehackernewsSun, Oct 11, 2026, 07:28 AM
Products·launched
Beta9: open-source, self-hostable GPU inference and sandbox infrastructure (Modal alternative)
Beta9 is an open-source AI infrastructure platform providing GPU inference and sandboxing primitives, positioned as a self-hostable alternative to Modal. It is not LLM-based itself; it runs AI/LLM workloads on your own Kubernetes cluster. It targets teams that want cloud-style serverless GPU infra without vendor lock-in.
Beta9 is an open-source AI infrastructure platform providing GPU inference and sandboxing primitives, positioned as a self-hostable alternative to Modal. It is not LLM-based itself; it runs AI/LLM workloads on your own Kubernetes cluster. It targets teams that want cloud-style serverless GPU infra without vendor lock-in.
2 engagement1 sourcehackernewsSun, Sep 13, 2026, 03:34 PM
Products·launched
InferCrane: open-source platform for self-hosted AI model deployment and rollback
InferCrane is an open-source infrastructure platform for operating self-hosted, open-weight, and custom-model inference in production. It provides a stable OpenAI-compatible endpoint that manages the full lifecycle of model deployments, including revision deployment, traffic routing, scaling, monitoring, and rollback. It solves the operational complexity of running AI models in production for developers and teams.
InferCrane is an open-source infrastructure platform for operating self-hosted, open-weight, and custom-model inference in production. It provides a stable OpenAI-compatible endpoint that manages the full lifecycle of model deployments, including revision deployment, traffic routing, scaling, monitoring, and rollback. It solves the operational complexity of running AI models in production for developers and teams.
1 engagement1 sourceredditThu, Aug 27, 2026, 10:12 PM
Releases·Tool Release
Quartermaster: open source local AI platform, a llama-swap fork, auto-configures GGUF models behind one OpenAI-compatible API
A developer announced Quartermaster, an open source local AI platform that began as a fork of llama-swap and has since grown into its own project. Users point it at a models folder and it auto-configures runtime settings by reading GGUF headers and measuring free VRAM. It targets ease of use while keeping all settings editable per model.
A developer announced Quartermaster, an open source local AI platform that began as a fork of llama-swap and has since grown into its own project. Users point it at a models folder and it auto-configures runtime settings by reading GGUF headers and measuring free VRAM. It targets ease of use while keeping all settings editable per model.
44 engagement1 sourceredditThu, Sep 3, 2026, 07:36 PM
Releases·Tool Release
A Deep Dive into Self-Hosting LLMs on Kubernetes
A Medium article explores the practical challenges of running open-weight LLMs in production on Kubernetes, covering deployment, scaling, and operational considerations. The piece targets developers and engineers looking to move beyond simple model serving.
A Medium article explores the practical challenges of running open-weight LLMs in production on Kubernetes, covering deployment, scaling, and operational considerations. The piece targets developers and engineers looking to move beyond simple model serving.
0 engagement1 sourcerssThu, Jul 30, 2026, 10:31 AM