Member-only story
Ultralytics YOLO/SAM with ROCm 7.0 on AMD Ryzen AI Max+395 “Strix Halo” (Radeon 8060S, gfx1151)
We previously introduced the $600+ Intel Core Ultra 5 Mini PC, which mainly has two issues in actual use:
- Insufficient GPU performance
- IPEX-LLM’s support for some of the latest models isn’t exactly slow, but still lags behind the update pace of new CUDA-first models
For about three times the price, you can get the GMKtec EVO-X2. It comes with the AMD Ryzen AI Max+395 APU, which offers larger unified memory (128GB) — meaning bigger VRAM (96GB) — and higher memory bandwidth, stronger GPU compute power, as well as better compatibility with rapidly evolving AI models thanks to the ROCm software stack. For example, in PyTorch, AMD GPUs can to some extent be treated like CUDA devices.
On AMD’s official site, AI Max+395 is currently only supported by ROCm 6.4.4 for Linux and Windows. However, this performance review states: “Ubuntu 24.04.3 LTS with the Linux 6.14 kernel and installing ROCm 7.0 along with the latest AMDGPU DKMS driver, the ROCm 7.0 compute stack was working out fine.” So let’s first figure out how to install it.
The GMKtec EVO-X2 comes with Windows 11 Pro preinstalled. We set up Ubuntu 24.04.3 LTS Server on an external hard drive. Then we updated the Linux kernel:
