AMD released ROCm 10.0, a major version of its open GPU compute stack, framed around agentic AI workloads. The jump from 7.14 to 10.0 came just a month after the previous release, and llama.cpp support is pending via an open pull request.
AMD Ryzen AI Developer Platform OS updated with ROCm 10.0, Linux 7.2
AMD Ryzen AI Developer Platform OS updated with ROCm 10.0, Linux 7.2
AMD has tagged a tech preview of ROCm 7.14, codenamed 'TheRock', for its latest GPU compute stack. The preview is available for testing and includes support for newer AMD GPUs. This release aims to improve performance and compatibility for AI and HPC workloads on AMD hardware.
AMD has tagged a tech preview of ROCm 7.14, codenamed 'TheRock', for its latest GPU compute stack. The preview is available for testing and includes support for newer AMD GPUs. This release aims to improve performance and compatibility for AI and HPC workloads on AMD hardware.
Phoronix reports AMD Linux 7.4 drivers boost Radeon iGPU AI/LLM performance up to 18-23%
Phoronix reports AMD Linux 7.4 drivers boost Radeon iGPU AI/LLM performance up to 18-23%
A developer, with GLM, created a llama.cpp fork optimized for AMD GFX906 GPUs (Mi50, Mi60, Radeon VII) using GCN HIP. The fork aims to improve performance on these older AMD accelerators. The developer shared it on a forum seeking feedback.
A developer, with GLM, created a llama.cpp fork optimized for AMD GFX906 GPUs (Mi50, Mi60, Radeon VII) using GCN HIP. The fork aims to improve performance on these older AMD accelerators. The developer shared it on a forum seeking feedback.
AMD maintains its own llama.cpp branch with ROCm/Hip patches that can more than double prompt processing speed on dense models. A user reports 550 tokens/s with a 14B dense model versus 230 tokens/s on standard llama.cpp, though token generation is about 15% slower than with Vulkan.
AMD maintains its own llama.cpp branch with ROCm/Hip patches that can more than double prompt processing speed on dense models. A user reports 550 tokens/s with a 14B dense model versus 230 tokens/s on standard llama.cpp, though token generation is about 15% slower than with Vulkan.