Ask HN: What are you running locally on your machine with LLMs?

agcat1 pts0 comments

There is a lot of buzz around this topic but i am really curious about what s actually useful day to day when running AI/LLMs locally on your PC. A few things I m trying to understand:Which models are you running locally and on what hardware? What use cases have actually worked out considering the speed and memory limitation? At what point did local start making more sense than just hitting an API? What s still not there yet?Feels like we re at an interesting inflection point but hard to cut through the noise on what s working v/s just setting it up

running locally llms actually point machine

Related Articles