OpenHands LM – Coding focused language model based on Qwen 2.5 coder:

* 7B (iOS + macOS) – 8GB RAM or more
* 32B (macOS only) – 32GB RAM minimum

Handles bug fixing and code refactoring tasks. Trained on real GitHub issues via reinforcement learning.

Meta-Llama 3.1 8B SurviveV3 (3-bit iOS / 4-bit macOS)

Wilderness survival assistant, offline. Knows how to build shelters, find water, navigate terrain, etc. 



Runs on any iOS/Mac device with 8GB+ RAM — even off-grid.

Llama 3.1 8B UltraMedical (3-bit iOS / 4-bit macOS)

Biomedical assistant for med students, researchers, and clinicians.
Answers board-exam style questions, explains research findings, and supports clinical reasoning — privately.

Runs on 8GB+ RAM.

Perplexity’s R1 1776 Distill Llama 70B


Post-trained to eliminate refusal behavior on politically sensitive topics — while preserving full reasoning ability.

Built to refuse censorship: open dialogue, independent thought, and the right to answer freely.

macOS only. Needs 48GB+ RAM.

Amoral-Gemma3-1B-v2 & gemma-3-1b-it-abliterated

Uncensored 4-bit Omniquant quantized fine-tunes of Gemma 3 1B.
For users who want unrestricted conversations, roleplay, and truth-seeking without moral filters. Fast and small. iOS and macOS.

Gemma 3 1B IT (4-bit QAT)
Instruction-tuned.

Multilingual. Full 32K context on iPhones with ≥ 6GB RAM.



Ideal for writing, Q&A, summarization — in 140+ languages.



Small enough to run on any supported iOS or Mac device.

Private LLM v1.9.7 (iOS) and v1.9.9 (macOS) are out.

This update brings Gemma 3 1B to all devices — iPhone, iPad, Mac.
And Perplexity’s R1 1776 Distill Llama 70B to beefy Macs for uncensored reasoning.


Plus new models for coding, survival, and biomedicine — all local, all private. 🧵

👀 Also, we've updated our lineup by adding support for both 3-bit and 4-bit OmniQuant quantized versions of the EVA LLaMA 3.33 70B v0.1 model by @Nottlespike. Note that we've deprecated the previous version, EVA LLaMA 3.33 70B v0.0

📏 Now, with Private LLM, you can see the context length right in the model quick switcher! This little upgrade makes a big difference, helping you choose the perfect model for your conversation or task at a glance.

✍️ Unleash your creativity with the Gemma 2 iFable 9B model from iFable! This top-tier creative writing model works on iPad Pros with 16GB of RAM or any Apple Silicon Mac with 16GB+ RAM. No other local LLM app lets you run 9B or 14B models on iOS like Private LLM can.

Private LLM v1.9.6 for iOS and v1.9.8 for macOS are here with 12 new models! From uncensored chats to creative writing, there's something for everyone. Let's dive in! 🧵