A developer shares cmdshellmcp, a Python shell MCP server that constrains LLM shell access, after IBM Granite 4.2 8B (Q4_K_M) in OpenCode hallucinated tool use and attempted root-path file writes. Running the model through llama-server with the MCP server, the same Flask 'hello world' task completes correctly in one shot.
A lightweight fine-tuned Qwen2.5-1.5B-Instruct guard model that detects indirect prompt injection in tool calls for local agents (Ollama, llama.cpp, vLLM with MCP or shell access). It replaces heavier options like Llama Guard 3 or cloud guardrail APIs, which cost VRAM, 150-500ms latency, or privacy leaks. Aimed at developers running local tool-using agents on untrusted content.
A lightweight fine-tuned Qwen2.5-1.5B-Instruct guard model that detects indirect prompt injection in tool calls for local agents (Ollama, llama.cpp, vLLM with MCP or shell access). It replaces heavier options like Llama Guard 3 or cloud guardrail APIs, which cost VRAM, 150-500ms latency, or privacy leaks. Aimed at developers running local tool-using agents on untrusted content.
A Reddit user wired a local uncensored Qwen quantized model into GIMP using llama.cpp's MCP server support and the community gimp-mcp tool, prompting it to draw a flower. The setup works but output quality is poor, with the user attributing results to the small model size.
A Reddit user wired a local uncensored Qwen quantized model into GIMP using llama.cpp's MCP server support and the community gimp-mcp tool, prompting it to draw a flower. The setup works but output quality is poor, with the user attributing results to the small model size.
A developer tested Meta's Muse Glimmer 30B model locally using llama.cpp and connected it to Hermes Agent, achieving about 22 tokens per second on an M5 Pro. The model performed correct tool calls and produced working code, unlike when run with OpenCode.
A developer tested Meta's Muse Glimmer 30B model locally using llama.cpp and connected it to Hermes Agent, achieving about 22 tokens per second on an M5 Pro. The model performed correct tool calls and produced working code, unlike when run with OpenCode.
A user reports that Qwen3.6 models hosted via Ollama fail to execute tool calls in harnesses like oh-my-pi, qwen-code, and opencode, printing tool calls as output instead. The same model works correctly when served via LM Studio, suggesting an Ollama-specific issue.
A user reports that Qwen3.6 models hosted via Ollama fail to execute tool calls in harnesses like oh-my-pi, qwen-code, and opencode, printing tool calls as output instead. The same model works correctly when served via LM Studio, suggesting an Ollama-specific issue.
Multiple users report that Muse Glimmer, a local LLM, overcomplicates simple tasks and gets stuck in long terminal tool-call sequences, exhausting context and hitting tool-call limits. The behavior appears specific to Muse Glimmer, as other models like DeepSeek v4 Flash 0731 and Qwen3.6 27B handle similar prompts with far fewer calls.
Multiple users report that Muse Glimmer, a local LLM, overcomplicates simple tasks and gets stuck in long terminal tool-call sequences, exhausting context and hitting tool-call limits. The behavior appears specific to Muse Glimmer, as other models like DeepSeek v4 Flash 0731 and Qwen3.6 27B handle similar prompts with far fewer calls.