Ask HN: Thoughts on AMD Ryzen AI MAX+ 395 for Local AI?

mempirate1 pts0 comments

Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models: - Practical limit on number of parameters x quantization - What you ve been using it for - Which models and inference engines combine well

local models thoughts ryzen wondering anyone

Related Articles