LM Link – This is the future I want

smalltorch1 pts0 comments

There has been a few posts about LM Link here on HN, but I don t believe this has gotten the attention it deserves.https://news.ycombinator.com/item?id=47155258Finally got around to dusting off a old setup and I am thrilled with the results. I m using a 200$ used GPU and 11year old CPU. Basically a retired game rig. I can now host a private model to my entire family that is just as capable as the things they were using it for without worrying of all the private information leaking out. While I am extremely impressed on the outputs of the local model, I am not to concerned about its quality. It s fine. What s more exciting is it s a path forward to data sovereignty and ownership.Great job on the privacy policy.https://locallyai.app/privacy-policy.htmlSetup was easy.As hardware improves, and local models improve...this is the way.The connection is powered by tailscale, long-term I would like to see other implementations of this wire to diversify how these devices are connecting.Iroh, recently posted here comes to mind... But in general, a stream of text is not a heavy payload and shouldnt need to rely on a loss-leader from any one place.

link https setup using private model

Related Articles