Run an LLM on Your Laptop for Free With Ollama

  • Beginner
  • 4 steps
  • By The Rundown University

Rundown Pro

Every course and recording, the certification program and member perks, for $29 a month. Guides stay free.

Go Pro for $29

This guide teaches you how to install Ollama and chat with a real AI model that runs entirely on your laptop. You will produce a local AI chat setup for drafting, summarizing, and brainstorming, with no account, subscription, or cloud processing required. The source frames this as a lightweight setup you can get installed tonight.

Step by step 4 steps

  1. Step 1 of 4

    Install Ollama

    Go to ollama.com/download and download the installer for your operating system. No account, sign-in, or setup is required first.

    • Mac: open the downloaded file and drag the Ollama icon into your Applications folder.
    • Windows: run the installer and click through the wizard.
    • Linux: open a terminal and run curl -fsSL https://ollama.com/install.sh | sh .

    Once it is installed, open Ollama from your Applications folder or Start menu.

    Pro tip: Mac users who prefer Homebrew can run brew install ollama instead of using the .dmg installer.

  2. Step 2 of 4

    Pick a Model That Fits Your Machine

    Click New Chat in the Ollama app, then click the model dropdown at the bottom of the chat window. The right model depends on how much RAM your machine has. The source tested gemma3:4b on a 16 GB MacBook and found it ran comfortably.

    CleanShot 2026-04-16 at 16.39.40@2x
    • 4 GB RAM: gemma3:1b, qwen3:0.6b, or tinyllama. These are tiny models: fast, but with limited reasoning, best for short rewrites and simple Q&A.
    • 8 GB RAM: gemma3:4b, llama3.2:3b, or phi4-mini. This is the everyday tier for chat, drafting, and summarizing.
    • 16 GB RAM: gemma3:12b, llama3.1:8b, or qwen3:8b. This is the sweet spot for most laptops and is noticeably smarter for real writing work.
    • 32 GB+ RAM or a discrete GPU: gemma3:27b, gpt-oss:20b, or qwen3:32b. These are heavyweight models and the closest you will get to cloud quality on a single machine.

    Apple Silicon Macs share memory between CPU and GPU, so a 16 GB M-series Mac generally runs models that a 16 GB PC struggles with. Pick a model and Ollama downloads it the first time you select it, then caches it after that.

    Pro tip: Browse ollama.com/search to see every model Ollama supports, including specialized models for coding, vision, and tool use.

  3. Step 3 of 4

    Start Chatting in the App

    Once the model finishes downloading, type a prompt and hit enter. You are now chatting with an AI model running entirely on your laptop, with no internet call, API key, or per-token cost.

    The first response is usually slower because the model has to load into memory. After that, replies stream in faster.

    Pro tip: If you prefer the terminal, run ollama run gemma3:4b instead. It is the same model and the same chat, without the GUI.

  4. Step 4 of 4

    Test That It Runs Locally

    Turn on airplane mode or unplug your ethernet cable, then send another prompt. It should still work, because the model is running locally instead of hitting a server.

    This is the point of running local AI: nothing is hitting a server, nothing is being stored anywhere, and you are not paying for each response. If you handle client NDAs, internal financials, or anything you would not paste into a hosted AI tool, this distinction matters.

That's the whole workflow

Mark it complete to keep your progress. The background follows.

Keep learning with Rundown Pro

Guides stay free. This is what Rundown Pro adds:

  • Every course and recording
  • The Rundown Certified Operator program
  • Member perks

$29/mo, cancel anytime

Background and context

Who This Is Useful For

  • Consultants and agency owners who handle client information they do not want sent to a third-party server.
  • Marketers, writers, and operators who want to iterate on prompts without watching a usage meter.
  • Anyone curious about local AI who does not want to sign up for another subscription just to try it.

What You Will Build

You will build a working local AI chat setup using the Ollama desktop app. The model lives on your hard drive, runs on your CPU or GPU, and works offline once it has downloaded.

CleanShot 2026-04-16 at 16.38.38@2x

What You Need

  • A reasonably modern laptop running Mac, Windows, or Linux.
  • At least 8 GB of RAM is ideal, though 4 GB works with a smaller model.
  • At least 3 to 8 GB of free disk space, depending on the model you pick.
  • No account or subscription is required.

Going Further

  • Wire up a coding agent. Ollama can launch Claude Code, Codex, or OpenCode against the model you downloaded using ollama launch claude, ollama launch codex, or ollama launch opencode.
  • Give your model tools and web search. Ollama exposes a local API at http://localhost:11434 and supports tool calling, so you can connect it to web search, file readers, and other utilities.
  • Move it to a dedicated machine. An old Mac mini, a recent used M-series Mac mini, or a repurposed PC can become an always-on local AI box that other devices on your home network can reach.