LocalLightChat – New AI Chat UI that handles 500k tokens on a 15 year old laptop

JustMyNews1 pts0 comments

LocalLightChat – Portable. Fast. Yours.

☰ Menu

AI Chat Interface

LocalLightChat

Portable. Fast. Yours.

Handles 500k+ Tokens smoothly on Enterprise Hardware.<br>Handles 500k+ Tokens smoothly on your 15 year old laptop.

The ultimate Chat UI for Local AI and Cloud APIs.

Download<br>Details

Cold Start

500k+

Context Tokens

Download

100%

Portable

Folder Structure & Chat Management

Image Generation

Code Preview

Realtime Web Search and Fetch

Markdown, Mermaid and Math

Compress 50k tokens in 2k with "Compress & Clone"

Editable Documents & Artifacts

What Sets This Apart

Fulltext search across unlimited history —

Compress 50k tokens to 2k — semantic extraction preserves decision-critical context

Documents & Artifacts — create, edit and refine long-form outputs without flooding the chat

Efficient web search - make complex research with minimal token usage

Easy Image Generation - via API or Auto-Detection of ComfyUI Bindings

Feature Parity without Overhead

Core

Multi-chat management with folder structure, templates, auto-rename, clone/compress, server-side search, documents and editable artifacts. Import/export included.

Extensions

Web tools (fetch/search via Serper/Brave/Custom), image generation (OpenAI/ComfyUI), voice (transcribe/TTS with streaming).

Control

Complete LLM parameter control (temperature, sampling, DRY, Mirostat), connection management, advanced telemetry.

Multi-Modal Input

Attachments (PDF, images, CSV, YAML, XML, logs etc.), URL sources, text notes. Client-side processing for maximum performance.

Rendering

Custom markdown pipeline, Mermaid-SVG, math/TeX, code syntax highlighting with export options.

User System

Role-based auth (superadmin/admin/user), granular settings inheritance, connection sharing.

Deployment

Portable 1-Click

Standalone binaries for Windows, Linux (x64/ARM64) and macOS. No installation, just launch.

Download Releases

Windows (x64)

Linux (x64)<br>Linux (ARM64)

MacOS (coming soon)

Platforms: Win64, Linux x64/ARM64, macOS

Version: 0.5

Self-Hosted

Own nginx/PHP stack. Clone repository, configure, deploy. Complete infrastructure control.

GitHub Repository

Requires: nginx or similar, PHP 8.x, SQLite

Docker Container

Pre-configured image for seamless deployment. One command, runs everywhere.

Show Docker Command

Platform: amd64, arm64

Image: srwarenet/locallightchat:latest · View on Docker Hub

Enterprise Edition

SSO Authentication

Seamless integration with existing identity infrastructure via SAML 2.0, OAuth 2.0, and OIDC. Support for Azure AD, Okta, and custom providers.

PostgreSQL Support

Enterprise-grade database backend with replication, partitioning, and connection pooling for high-availability deployments at scale.

Custom Branding

White-label deployment with custom logos, color schemes, and domain configuration. Complete UI customization to match corporate identity.

Advanced User Management

Granular permissions with custom roles, department-level segregation, and hierarchical access control. Automated provisioning workflows.

Audit & Logging

Comprehensive audit trails with immutable log storage. Compliance-ready reporting for SOC 2, ISO 27001, and GDPR requirements.

Ready to Scale?

Get in touch with our team to discuss your enterprise requirements and receive a tailored proposal.

Contact for Quote

Support the Project

If LocalLightChat saves you time (or makes local AI actually usable), you can throw a tip in.<br>No drama, no subscriptions required.

Via PayPal

Classic one-click donate using a hosted PayPal button.

PayPal Hosted Button

Via Credit Card

Stripe checkout link for card payments. Fast, simple.

Open Stripe Checkout

Stripe Link: buy.stripe.com/14AaEZ6E3aZ786Wdjr7bW02

Via Bitcoin

Send any amount to the address below.

bc1q6m5uuztqvws4guhyc3xfayxejunv8y54eh5n5l

Copy Address

Network: Bitcoin (be careful with copy/paste)

Docker Command

Choose shell and bind address, then copy the command.

Shell / OS

Linux<br>macOS<br>Windows

Bind address

127.0.0.1 only<br>0.0.0.0 public

Linux / local<br>Copy

Image: srwarenet/locallightchat:latest · View on Docker Hub

Local binds the ports to this machine only. Public exposes them on the host network, so use it only when firewall, auth and TLS are intentional.

locallightchat chat tokens image custom linux

Related Articles