Show HN: Best setup local LLM found for a 5090

utopman1 pts0 comments

Hi folks, I found this setup on consummer hardware that seems to have great results on local hardware. - qwen 3.6 q6 - 450 K context using turboquant turbo3 mode llama.cpp fork - multimodal supportThis AI generated blog article is a kind of report of what and how I did and result exemples.I hope this can be usefull to some peopole.Note : I am not much intersted in having success with this article, I mainly want to share what I think is an interesting use of a 5090. I generated the blog page telling AI to be compliant with hn rules and remain factual.

quot setup local found hardware generated

Related Articles