Circuitry Logo
Circuitry
Open Circuitry

Run AI on your own computer

Circuitry can use local models, AI models that run on your own computer: on a Mac, Circuit sets up and runs MLX models for you, and on any computer it uses Ollama or LM Studio. Pick one under Set up AI… → Other ways → Local models in the Ask box, and reach it from your phone or tablet through Circuit.

MLX models on a Mac

Desktop appYour own AIFree

For a Mac with Apple silicon and macOS 15 or later. There is nothing to install yourself.

  1. In the Ask box, open the chip (it says Auto until you pick something) and choose Set up AI…, then Local models.
  2. Under MLX (this Mac), click Set up MLX models. Circuit downloads what it needs and starts it.
  3. Pick a model under Suggested, or search for one. Each shows its download size and the memory it needs; models that fit this Mac come first.
  4. Click Download. Large models take a while; you can close the window and the download carries on.
  5. When it finishes, pick the model to start a chat with it.

Ollama or LM Studio (Mac, Windows, Linux)

Desktop appYour own AIFree

On Windows and Linux, local models run in Ollama or LM Studio, which you install yourself from their websites.

  1. Start Ollama and download a model in it, or open LM Studio, load a model and start its local server.
  2. In Circuitry, choose Set up AI… → Local models. The models it finds are listed under Ollama and LM Studio. If nothing shows, press Rescan.
  3. Pick a model and the chat opens on it. A model marked "chat only" can talk but cannot use tools.

Use it from your iPhone, iPad or Android

Phone or tabletYour computer (Circuit)Paid plan

The model keeps running on your computer; the phone or tablet sends it your requests.

  1. Pair the device with the computer. See Connect your phone or tablet to your computer.
  2. Open the chip in the Ask box, or the model picker in a chat. Models on that computer are listed with the computer's name.
  3. MLX models appear once they are downloaded. Ollama and LM Studio models appear once you have picked them in Circuitry on that computer.

You can also set up and download MLX models from the phone: Set up AI… → Local models works on the paired Mac. With Home Circuit on, this works away from home too. The computer has to be on and awake.

If a model is slow or the computer runs out of memory

Open Settings → Models. It lists the models running on each computer with Circuit and the memory each uses, with Stop and Stop all local models. This works from your phone or tablet too.

Related