omm

omm run

Start a chat with a model already installed via omm — Ollama chats right here in the terminal, KoboldCpp and text-generation-webui start with the model loaded, GUI apps just open.

01 / 06

Overview

Reach for run once install has finished. With no name, run offers an interactive pick from what's installed; with a name, it resolves which runners that model is linked into and either drops you straight into a terminal chat (Ollama), launches the model already loaded (KoboldCpp, text-generation-webui), or opens the GUI app so you can pick it from its own local-models list. --engine overrides the automatic choice when a model is linked into more than one runner.

02 / 06

Options

Every flag this command accepts, and what it defaults to when you leave it out.

  • [name]—Default: picks interactively

    An installed model's filename (see omm list). Left out, run offers an interactive pick from what's installed.

  • --engineNAMEDefault: auto-picks a linked engine

    Which linked runner to use: ollama, lmstudio, jan, koboldcpp, textgenwebui, anythingllm, or mstystudio. Left out, run picks one automatically.

03 / 06

Examples

From a plain search to something you'd put in a script.

No name — pick interactively from what's installed.

$ omm run

Run a specific installed model, letting run pick the runner.

$ omm run qwen2.5-0.5b-instruct-q4_k_m.gguf

Run the same model through a specific runner instead of the automatic pick.

$ omm run qwen2.5-0.5b-instruct-q4_k_m.gguf --engine lmstudio

04 / 06

A real run

Real omm run qwen2.5-0.5b-instruct-q4_k_m.gguf chat, 2026-08-25, this dev machine — a real question sent to a real, already-installed model through a real running Ollama, with the real generated answer shown exactly as it came back (nothing here is scripted dialogue). "Started Ollama in the background for this chat." is skipped in this particular run because Ollama was already running — omm run only prints that line when it had to start the daemon itself.

06 / 06

If something goes wrong

Every message below is one this command actually prints. Find yours, read why it happened, then do the last line.

  1. totally-fake-model-xyz is not installed via omm. See `omm list`.
    why
    The name doesn't match anything omm has installed on this machine — it may be misspelled, or installed under a runner directly rather than through omm.
    what to do
    Run omm list to see the exact filename omm knows about, then pass that.
    source
    src/omm/cli.py:5536
  2. Ollama is not installed. Install it from https://ollama.com/download.
    why
    run picked (or was told to use) Ollama, but no Ollama installation was found on this machine.
    what to do
    Install Ollama from the link in the message, then retry.
    source
    src/omm/launcher.py:170
  3. `ollama run mistral-7b-instruct-v0.2.q4_k_m` exited with code 1. Try `omm link --engine ollama` to repair the model's Ollama link.
    why
    The model is linked into Ollama, but the ollama run itself failed or the link is stale.
    what to do
    Run omm link --engine ollama to re-verify and repair the link, then retry.
    source
    src/omm/launcher.py:177-183

Still stuck? Open an issue with the exact message you saw.

All commands