How To Replace Siri With a Free Local Model

  • Beginner
  • 6 steps
  • By The Rundown University

This guide shows you how to download a free AI model to your iPhone and connect it to the Action Button so it works like a voice assistant. After setup, the model runs locally, so you can use it without an internet connection and without sending private prompts to a cloud service. The model download can take a few minutes and requires several gigabytes of storage.

Step by step 6 steps

  1. Step 1 of 6

    Download Locally AI

    Open the App Store and download Locally AI.

    Once it installs, open the app and continue through the welcome screen.

  2. Step 2 of 6

    Choose Your First Model

    When the app asks you to choose a model, start with the latest Gemma model available in the app.

    image-2194

    Gemma is Google’s open-source model family and is a strong first pick for this setup. It is good enough for normal assistant tasks and gives you a clean baseline before you start testing bigger models.

    Pro tip: Download models on Wi‑Fi before you need the assistant offline. Most models are several gigabytes.
    Pro tip: Model names usually include sizes like 4B, 6B, or 8B. That number is roughly the model’s parameter count. Bigger usually means more capable, but it also means a bigger download and slower performance on your phone.

  3. Step 3 of 6

    Download and Test the Model

    Tap download and keep the app open while it finishes. This may take a few minutes because you are downloading the actual model file onto your phone, which can be a few gigabytes.

    Once the model is installed, try one quick prompt before you connect it to the Action Button.

    Give me a quick plan for the three most important things I should do before a 30-minute client call.
    image-2198

    This test gives you a feel for speed and answer quality. If it responds well enough for quick assistant tasks, you are ready to bind it to your phone.

  4. Step 4 of 6

    Open Action Button Settings

    Swipe down on your home screen and search for Action Button.

    image-2199

    Open the Action Button settings. Swipe through the options until you see Shortcut.

  5. Step 5 of 6

    Choose Locally AI Voice Mode

    Tap whatever is currently set as the shortcut, then search for Locally AI.

    image-2200

    Select Voice Mode. Your Action Button should now be set to Locally AI Voice Mode.

    image-2201

    Press the Action Button and wait for the chime. The first time you open Voice Mode, Locally AI may ask you to download a speech-to-text model. Download it. This separate model lets the app handle voice input locally.

    Pro tip: If Voice Mode does not launch right away, go back into the Action Button settings and confirm the selected shortcut says Locally AI Voice Mode, not New Chat.

  6. Step 6 of 6

    Test Your Local Assistant

    Press the Action Button and ask a question out loud.

    Explain the difference between local AI and cloud AI in simple terms.
    Translate "I will send the document this afternoon" into Spanish.
    Give me three ways to prepare for a quick client call.

    Local models can be useful, but they are not perfect. They may be less reliable than large cloud models like ChatGPT or Claude. For everyday assistant tasks, the tradeoff can still be worth it: explaining concepts, translation, quick planning, and simple rewrites are all good fits.

    Pro tip: After the model and speech-to-text model are downloaded, turn on airplane mode and ask another question. If it still responds, you have proved the important part: the assistant is running locally on your phone.

That's the whole workflow

Mark it complete to keep your progress. The background follows.

Keep learning with Rundown Pro

Guides stay free. This is what Rundown Pro adds:

  • Every course and recording
  • The Rundown Certified Operator program
  • Member perks

$29/mo, cancel anytime

Background and context

Who This Is Useful For

  • iPhone users with an Action Button who want a better assistant shortcut than Siri
  • Privacy-focused users who want more AI tasks to run on-device
  • People curious about local AI who want an easy first model to test
  • Anyone who wants a quick voice assistant for explaining concepts, translating text, or working through small tasks

What You Will Build

IMG_3010

You will turn your iPhone’s Action Button into a shortcut for a local AI assistant that can run on your phone without an internet or cellular connection after the initial model downloads are complete.

  • A downloaded local AI model in Locally AI
  • An Action Button shortcut set to Locally AI Voice Mode
  • A local voice assistant you can test with practical prompts

What You Need

  • An iPhone with an Action Button, such as iPhone 15 or newer
  • The Locally AI app
  • 3+ gigabytes of storage space
  • Wi‑Fi for the initial model downloads

Going Further

  • Once the newest Gemma model is working, try downloading a bigger model and running the same prompts through both. Compare speed, storage use, answer accuracy, and which one sounds better out loud so you can find the model that is useful enough, fast enough, and private enough for your phone assistant tasks.