KTransformers 0.7 Expands AVX-512 Support To Benefit AMD EPYC Servers - Phoronix
Articles & Reviews
News Archive
Forums
Premium Ad-Free<br>Contact
Popular Categories
Close
Articles & Reviews
News Archive
Forums
Premium
Contact
Categories
Computers Display Drivers Graphics Cards Linux Gaming Memory Motherboards Processors Software Storage Operating Systems Peripherals
KTransformers 0.7 Expands AVX-512 Support To Benefit AMD EPYC Servers
Written by Michael Larabel in AI on 17 August 2026 at 07:28 AM EDT. 1 Comment
KTransformers as the framework for heterogeneous LLM inference and fine-tune optimizations is out today with its v0.7 feature release.
With KTransformers 0.7 there is now full AVX-512 support for LoRA fine-tuning without depending upon Advanced Matrix Extensions (AMX) also being present. This AVX-512-only without AMX benefits AMD EPYC Zen 4 / Zen 5 / Zen 6 servers with excellent AVX-512 support while lacking AMX and also older Intel Xeon processors with AVX-512 prior to the introduction of AMX with Sapphire Rapids.
The merge request noted the testing on AMD hardware and the foxus on AVX-512 without AMX platforms. The KTransformers runtime will automatically select the proper CPU implementation and in turn allowing MoE expert training to happen on a wider range of large-memory servers.
KTransformers 0.7 also adds VLM fine-tuning support, native FP8 LoRA support, improved DeepSeek V4 deployment, and CPU activation reuse.
More details on KTransformers 0.7 for those using it for LLM inference optimizations and fine-tuning can find all the details via the release announcement on GitHub.
1 Comment
Tweet
Lemonade 11.6 Integrates Muse-Glimmer 30B, Experimental TheNoise ROCm Image Generation<br>OpenAI Brings ChatGPT Desktop App To Linux<br>Meta Publishes Muse Glimmer As 30B Open Agentic Model<br>Cloudflare Announces Open-Source Cloudflare OS As AI "Operating System"<br>Linux Foundation Announces Tokenomics Foundation For "Economics & ROI Of AI Value"<br>Linux Kernel Developers Again Discussing AI Agent Attribution - Potentially Dropping It
Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.
GNOME Designers Lay Out Some Of Their GNOME Shell Dreams<br>QEMU 11.1 Released With Numerous Improvements<br>OpenAI Brings ChatGPT Desktop App To Linux<br>Rsync 3.5 Released As "Extraordinary" Update To Fix 33 Security Issues<br>Comma.ai Launches A PCIe Gen4 x4 To USB4 Dock With Open-Source Firmware<br>Omarchy 4.0 Linux Distro Released With Desktop Shell Now Implemented Via Quickshell<br>CachyOS August 2026 Release Preps For Upcoming Server Edition<br>Linux 7.2-rc7 Released Following Another Exhausting AI-Driven Week
AMD Working On A New Backend For Improving ROCm Compute In QEMU/VMs
Linux 7.3 SMP Improvement To Help Reduce Latency, Improve Real-Time Performance
Firefox 154 Now Available With "Manage AI" Quick Action
Intel & AMD Power Management Driver Improvements Ready For Linux 7.3
KTransformers 0.7 Expands AVX-512 Support To Benefit AMD EPYC Servers
Con Kolivas Revives "-ck" Patches & MuQSS To Improve Linux Desktop Responsiveness
Linux 7.3 On PowerPC Now Supports In-Kernel Rust, Initial Power12 Enablement Begins
GNU Linux-libre 7.2-gnu Released Following More Driver Cleaning
Linux 7.2 Released With Faster I/O, New AMD & Intel Driver Improvements
GIMP Making Progress On New Project File Format After Nearly 30 Years With XCF
tlbi= Boot Option Submitted Ahead Of Linux 7.2 Kernel Release
Debian Marks 33rd Birthday As One Of The Oldest Maintained Linux Distros
AVX-512 xor_gen Continues To Look Exciting For Helping Linux RAID With Modern CPUs
Phoronix Premium allows ad-free access to the site, multi-page articles on a single page, and other features while supporting this site's continued operations.
ARCTIC Fan Controller: The Best Fan Controller For Linux Desktops, Less Than $10 USD
Linux 7.1, Linux 7.2 Performance On The Intel Xeon 600 Series
The Beneficial Performance Gains Running The Framework Laptop Pro 13 / Core Ultra X9 388H With Linux 7.1+
Intel AMX Performance With The Xeon 678X Workstation CPU
Analyzing Fedora's Slow Performance On The Framework Laptop 13 Pro With Intel Panther Lake
The mission at Phoronix since 2004 has centered around enriching the Linux hardware experience. In addition to supporting our site through advertisements, you can help by subscribing to Phoronix Premium. You can also contribute to Phoronix through tips/donations via PayPal or Stripe.
Contact
Michael Larabel
Support Phoronix
While Having Ad-Free Browsing,
Single-Page Article...