Ask HN: What does your local LLM setup looks like?

the-mitr1 pts0 comments

What models and hardware you are using? For what purpose? What were the challenges? Any tricks that helped you in doing this?This might help new users like me setup theirs.

setup like local looks models hardware