GitHub - ggml-org/Llama-macOS: A cosy home for your LLMs. · GitHub
/" data-turbo-transient="true" />
Skip to content
Search/
Sign in<br>Sign upAppearance settings
You signed in with another tab or window. Reload to refresh your session.<br>You signed out in another tab or window. Reload to refresh your session.<br>You switched accounts on another tab or window. Reload to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading. Please reload this page.
ggml-org
Llama-macOS
Public
Notifications<br>You must be signed in to change notification settings
Fork<br>101
Star<br>1.4k
main
BranchesTags
Go to file
CodeOpen more actions menu
Folders and files<br>NameNameLast commit message<br>Last commit date<br>Latest commit
History<br>1,128 Commits<br>1,128 Commits
Llama.xcodeproj
Llama.xcodeproj
Llama
Llama
.gitignore
.gitignore
LICENSE
LICENSE
contributing.md
contributing.md
readme.md
readme.md
View all files
Repository files navigation
Llama
Llama is a macOS menu bar app for running local LLMs.
Watch a 2-minute intro 📽️
Install
brew install --cask llama-app
Or download from Releases.
How it works
When you start Llama, it runs a local server at http://localhost:9931/v1.
If you have llama.cpp installed, Llama uses it. Otherwise, it installs a prebuilt binary for your Mac. Models you've already installed via llama.cpp show up in the app automatically. You can install any GGUF model from Hugging Face, and Llama also recommends models that fit your Mac's hardware.
You can chat with any model in the built-in WebUI, connect other apps (coding agents, chat UIs, editors), or use the API directly. Models load when requested and unload when idle, so they don't take up memory when not in use.
Features
100% local — Models run on your Mac; no data ever leaves it
Small footprint — 4 MB native macOS app
Zero configuration — models are auto-configured with optimal settings for your Mac
Model recommendations — a built-in list of models your Mac can run, installable in one click
Standard storage — models live in the Hugging Face cache, shared with llama.cpp and other tools
Built on llama.cpp — from the GGML org, developed alongside llama.cpp
Example requests
List installed models:
curl http://localhost:9931/v1/models
Send a message to a model:
curl http://localhost:9931/v1/chat/completions \<br>-H "Content-Type: application/json" \<br>-d '{<br>"model": "ggml-org/gpt-oss-20b-GGUF:MXFP4",<br>"messages": [{"role": "user", "content": "Hello"}]<br>}'
See complete API reference in the llama.cpp server docs.
Experimental settings
Expose to network — By default, the server is only accessible from your Mac (localhost). This option allows connections from other devices on your local network. Only enable this if you understand the security risks.
# bind to all interfaces (0.0.0.0)<br>defaults write app.llama.Llama exposeToNetwork -bool YES
# or bind to a specific IP (e.g., for Tailscale)<br>defaults write app.llama.Llama exposeToNetwork -string "100.x.x.x"
# disable (default)<br>defaults delete app.llama.Llama exposeToNetwork
Custom server arguments — Extra CLI arguments appended to the llama serve command, for server flags the app doesn't expose (e.g. --api-key). They come after the app's own flags, so where the server honors the later occurrence they can override the app's settings. Takes effect on the next server start.
# append custom arguments to the server command<br>defaults write app.llama.Llama extraServerArgs -string "--api-key secret"
# remove (default)<br>defaults delete app.llama.Llama extraServerArgs
About<br>A cosy home for your LLMs.<br>Topics<br>aillama-cppllmsmacosswift<br>Resources<br>Readme<br>MIT license<br>Contributing<br>Contributing<br>Activity<br>Custom properties<br>Stars<br>1.4k stars<br>Watchers<br>17 watching<br>Forks<br>101 forks<br>Report repository
Releases
Contributors
Languages
You can’t perform that action at this time.