My self-hosted LLM server setup to access open models anywhere remotely from my laptop. : LocalLLMjump to contentmy subreddits<br>edit subscriptions<br>popular<br>-all<br>-users<br>| AskReddit<br>-pics<br>-funny<br>-movies<br>-gaming<br>-worldnews<br>-news<br>-todayilearned<br>-nottheonion<br>-explainlikeimfive<br>-mildlyinteresting<br>-DIY<br>-videos<br>-OldSchoolCool<br>-TwoXChromosomes<br>-tifu<br>-Music<br>-books<br>-LifeProTips<br>-dataisbeautiful<br>-aww<br>-science<br>-space<br>-Showerthoughts<br>-askscience<br>-Jokes<br>-Art<br>-IAmA<br>-Futurology<br>-sports<br>-UpliftingNews<br>-food<br>-nosleep<br>-creepy<br>-history<br>-gifs<br>-InternetIsBeautiful<br>-GetMotivated<br>-gadgets<br>-announcements<br>-WritingPrompts<br>-philosophy<br>-Documentaries<br>-EarthPorn<br>-photoshopbattles<br>-listentothis<br>-blog

more "

reddit.com LocalLLMcomments

Want to join? Log in or sign up in seconds.

limit my search to r/LocalLLMuse the following search parameters to narrow your results:<br>subreddit:subredditfind submissions in "subreddit"author:usernamefind submissions by "username"site:example.comfind submissions from "example.com"url:textsearch for "text" in urlselftext:textsearch for "text" in self post contentsself:yes (or self:no)include (or exclude) self postsnsfw:yes (or nsfw:no)include (or exclude) results marked as NSFWe.g. subreddit:aww site:imgur.com dog<br>see the search faq for details.

advanced search: by author, subreddit...

this post was submitted on 20 Jun 2026<br>24 points (97% upvoted)<br>shortlink:

Submit a new link

Submit a new text post

LocalLLM<br>joinleave<br>a community for 3 years

MODERATORS

message the mods

106 &middot; 141 comments<br>QWEN 3.6 27B Q8 as Replacement for Claude Code Opus 4.7-4.8<br>&middot; 7 comments

My self-hosted LLM server setup to access open models anywhere remotely from my laptop.<br>73 &middot; 38 comments<br>I reverse engineered Windows Copilot into a free OpenAI compatible API (GPT-4o, no API key, no billing)<br>16 &middot; 2 comments

How to easily fine-tune a model yourself on an AMD Radeon: a fine-tuned 0.8B beat a 6.9B at my task — sharing the reproducible toolkit + free dashboard<br>11 &middot; 25 comments<br>Any local coding model perfect for vibe coders?<br>13

I built a local Qwen3-8B circuit generator that refuses to show circuits its deterministic verifier rejects<br>7 &middot; 8 comments

Loop Therapy<br>&middot; 1 comment<br>B70 OVMS vs VLLM vs VLLM+mtp<br>&middot; 6 comments<br>New to local LLM!

Qwen3.5-122B-A10B-APEX Balanced vs unsloth/Qwen3.5-122B-A10B-MTP UD-Q4_K_XL - no scientific proof but I found unsloth one to be better

Welcome to Reddit,<br>the front page of the internet.<br>Become a Redditorand join one of thousands of communities.

&times;

&bull;<br>&bull;<br>&bull;

DiscussionMy self-hosted LLM server setup to access open models anywhere remotely from my laptop. (i.redd.it)

submitted 1 hour ago by on_the_mark_data<br>7 comments<br>share<br>save<br>hide<br>report

I finally had time to work on my local LLM server yesterday! The setup pictured here allows me to securely access specific models I've already loaded and made available, or SSH into my server to do specific development work on my GPU (e.g., adding models, fine-tuning, etc.). Even better, it's fully end-to-end encrypted and requires OAuth to connect.

all 7 comments<br>sorted by: best<br>topnewcontroversialoldrandomq&alive (beta)

Want to add to the discussion?<br>Post a comment!<br>Create an account

[–]GavDoG9000 2 points3 points4 points 1 hour ago (2 children)<br>Nice one! Did you code up llama-swap yourself? I dived into Omnigent this week, now I realize I need a better solution to manage model serving across a few GPUs and services.

permalink<br>embed<br>save<br>report<br>reply

[–]on_the_mark_data[S] 6 points7 points8 points 1 hour ago (0 children)<br>I wish! It's a really cool project! https://github.com/mostlygeek/llama-swap

permalink<br>embed<br>save<br>parent<br>report<br>reply

[–]anony_mf 2 points3 points4 points 1 hour ago (3 children)<br>Where is your server hosted? I’m curious where did you learn to host your own models on the cloud and oauth as well?

permalink<br>embed<br>save<br>report<br>reply

[–]on_the_mark_data[S] 5 points6 points7 points 1 hour ago (2 children)

It's hosted in my office 😅. My background is in data science and data engineering, so I feel comfortable working with this stuff. I have a pretty powerful machine for fine-tuning and agentic simulation work.

permalink<br>embed<br>save<br>parent<br>report<br>reply

[–]anony_mf 1 point2 points3 points 40 minutes ago* (1 child)<br>Oh okay it’s a local server got it

Thanks

Could you recommend any learning resources that helped you gain technical skills on these different topics? Data Eng, networking, and model fine tuning.

I’m also in tech just curious what people are using to get the technical expertise because I keep bookmarking resources and feeling like they’re shit and never actually working through them :/

permalink<br>embed<br>save<br>parent<br>report<br>reply

[–]on_the_mark_data[S] 1 point2 points3 points 24 minutes ago (0 children)<br>I wish there were a single set of resources, but this space is so new that you honestly have to build it yourself and watch things break. This was a major...