V1.2.0 — LATEST RELEASE

Intelligence
in a box.

Run powerful language and mixture-of-experts models entirely on your Mac. Use MLX, stream large MoE experts from SSD, or use Apple Intelligence — all from one native chat app.

Apache 2.0 · Apple Silicon · macOS 26+ · 23 MB download
100%on-device inference
0bytes leave your Mac
3SSD-streamed MoE checkpoints
4K–32Kconfigurable SSD context
MLX-SWIFT-LM 3.31.4 · TURBOFIELDFARE · METAL 4 · APPLE SILICON
WHAT'S INSIDE

Download the app. Pick a model. Chat. No inference servers. No clients. Just local AI that feels like an app.

01 — CATALOG

A curated model catalog

Qwen, Gemma, Llama, Phi, DeepSeek — quantized for Apple Silicon. Import any MLX-compatible model from Hugging Face.

02 — SYSTEM MODEL

Apple Intelligence, built in

Zero downloads. Zero setup. Future Apple Intelligence upgrades come to MLX Chat automatically.

03 — REASONING

Thinking, disclosed

Watch reasoning models think in real time, with collapsible thinking blocks and live throughput metrics.

04 — ARTIFACTS

Artifacts, rendered live

The model writes HTML or SVG; it renders beside the chat in a sandboxed web view. Markdown, syntax highlighting, and LaTeX included.

05 — STORAGE

An honest model manager

Download with progress and cancel. Delete cleanly. MLX stays the default; Gemma 4 26B and Qwen3.6 35B can keep their shared core in memory and stream only routed experts from a resumable .gturbo install on SSD.

06 — MEMORY

Auto-Unload After

Idle models automatically give memory back after 2 minutes, 10 minutes, an hour, or never. When they're unloaded, the memory actually comes back.

THREE ENGINES · ONE PROTOCOL

One model in RAM.
Behind one protocol.

ENGINE 01 — MLX

Local weights, unified memory.

Quantized models load straight into Apple Silicon's unified memory and stay hot between turns.

  • KV-cached ChatSession reused across turns — no re-prefilling the conversation
  • History trimmed to 70% of the context window before prefill
  • Metal buffer cache capped at 20 MB — no gigabytes parked after unload
ENGINE 02 — SSD-STREAMED MOE

Large models, bounded memory.

Keep the shared core and FP16 KV cache in memory, then read only router-selected experts from SSD.

  • Gemma 4 26B-A4B standard and QAT, plus Qwen3.6 35B-A3B
  • 4K–32K context and 8–32 expert-cache slots — more RAM can reduce SSD reads
  • The router still runs the same top eight experts; cache size never lowers model quality
ENGINE 03 — APPLE INTELLIGENCE

The OS is the model manager.

The FoundationModels framework hands MLX Chat the system's on-device model. Nothing to ship, nothing to download, nothing to babysit.

  • Transcript-seeded LanguageModelSession, fresh per turn
  • Context-window and guardrail errors mapped to clear messages
  • Apple Intelligence, MLX, and SSD models share one picker and one chat interface
GET STARTED

Up and running
in two minutes.

Download the DMG or build from source. On Apple Intelligence–enabled Macs, chat works the moment the app opens — no model download needed.

macOS App Recommended

Drag to Applications. Chat with Apple Intelligence out of the box, or pull a local model from the built-in catalog.

Download DMG

From source

Requires an Apple Silicon Mac, macOS 26 with Xcode 26, and XcodeGen.

# clone and generate
git clone https://github.com/abayomipopoola/mlx-chat
cd mlx-chat && xcodegen generate

# build (mlx-swift ships a plugin + macros)
xcodebuild -scheme MLXChat -configuration Release \
  -skipPackagePluginValidation \
  -skipMacroValidation build