AMD Boosting AI/LLM Performance For Radeon iGPUs As Much As 18~23% With Linux 7.4
If you have an AMD Ryzen laptop/desktop and looking to leverage AI/LLM capabilities with the integrated graphics, Linux 7.4 is going to be a real treat especially for lower-end hardware. AMD's new PerfOpt feature being introduced in Linux 7.4 is set to provide some solid gains as shown in these benchmarks today across different AMD Ryzen/Radeon hardware.
AMD is enhancing AI/LLM performance for Radeon integrated graphics processors (iGPUs) by up to 18-23% in Linux 7.4. The new PerfOpt feature, introduced in this release, proves particularly beneficial for lower-end hardware. AMD's IOMMU Performance Optimization, part of the AMD I/O Virtualization Technology specification, bypasses the IOMMU when accessing system memory, eliminating associated overhead.
This feature is enabled by default for AMD integrated graphics when using Linux 7.4. To test the impact of PerfOpt, a test kernel was built from the IOMMU Git tree, comparing its performance with the feature disabled on an AMD Strix Halo desktop. The Lemonade local AI server with Llama.cpp back-end was utilized for local AI/LLM inferencing.
More benchmarks on Linux 7.4's overall performance will follow as the kernel cycle begins in October and the stable kernel release approaches the end of the year, potentially becoming the year's long-term support (LTS) kernel version.
Written by urgent.news from Phoronix's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
