Ollama vs Jan
Ollama wins · 26–13 (43 drawn)
Agenticness — how well agents can access and operate the productAgenticness
How well agents can access and operate the product
Agent access
ai-native userPoint an agent at llms.txt or agent-oriented docs
weight 2 · round to OllamaA probe confirms https://ollama.com/llms.txt returns HTTP 200 with structured agent-oriented content describing Ollama and its integrations, directly satisfying the story. Missing for 10: no docs.md or machine-readable OpenAPI spec (both 404), and no independent confirmation of agents actually consuming the llms.txt file.
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
- [probe] “PROBE docs-md: HTTP 404 at https://ollama.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
Jannone0/10No llms.txt or agent-oriented docs endpoint exists; probes confirm 404 at jan.ai/llms.txt and no openapi/swagger docs found, and no other evidence mentions such docs.
ai-native userRun the product headlessly / in CI for automation
weight 2 · round to OllamaOllama exposes a REST API and can be driven via curl, Python, or JS SDKs (ollama-gh-4, ollama-docs-9/10/11), which supports headless/scriptable use in automation contexts, and community reports confirm running it as a background service for bots/integrations (ollama-comm-4). However, there is no explicit CI documentation, GitHub Actions examples, or dedicated headless-mode/CI guidance in the evidence. Missing for 10: explicit CI/CD pipeline docs or examples, headless server flags/docs, and independent CI usage reports.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
Jannone0/10Jan is a desktop GUI app for local AI models; evidence shows a local OpenAI-compatible API server and MCP integration, but there is no evidence of a headless/CLI mode or documented CI automation workflow. missing for 10: headless/CLI launch mode, CI/automation documentation, evidence of running without GUI.
ai-native userPlug MCP servers into this product so it can use their tools
weight 3 · round to JanOllamanone0/10The evidence shows Ollama integrates with external coding agents (Claude Code, Codex, Copilot) as a model backend and exposes a REST API, but there is no evidence that Ollama itself acts as an MCP client that can plug in MCP servers to gain access to their tools. Missing for 10: any mention of MCP protocol support, MCP server configuration, or tool-use via MCP within Ollama itself.
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
GitHub docs explicitly list 'Model Context Protocol: MCP integration for agentic capabilities' as a feature, confirming the product supports plugging in MCP servers for tool use. However, there's no detailed documentation on setup, configuration, or independent hands-on confirmation of this working. Missing for 10: detailed first-party docs on MCP server configuration, independent/community corroboration of MCP tool usage in practice.
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
ai-native userUse an official CLI
weight 2 · round to OllamaOllama ships an official CLI ('ollama run', 'ollama pull', 'ollama rm', etc.) that is widely used and repeatedly confirmed in community evidence for model management, hotswapping, and launching agents like Claude Code/Codex with one command, making it a core agentic workflow tool. Missing for 10: no first-party CLI reference docs excerpt in the pack and no independent benchmark of CLI-specific agent orchestration beyond community anecdotes.
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
- [community] “No mention of the fact that Ollama is about 1000x easier to use. Llama.cpp is a great project but one of the least user friendly pieces of s…”
ai-native userDrive the product through a documented public API
weight 3 · round to OllamaOllama documents a REST API for running/managing models, with SDKs for Python and JS/TS, curl examples, and base URLs for local/cloud, plus community confirmation of wide integration with agents and tools. Missing for 10: a formal OpenAPI/Swagger spec (probe shows 404s) and independent third-party validation of API completeness.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
Jan exposes an OpenAI-compatible local API server (localhost:1337) that lets other applications drive it programmatically, which is a documented public API surface. However, probes found no discoverable OpenAPI/swagger spec or llms.txt, suggesting the API documentation is not comprehensively published or easily discoverable. Missing for 10: a formal published OpenAPI/swagger schema, hosted API reference docs, and independent confirmation of API completeness/versioning.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
ai-native userIssue scoped/least-privilege API credentials for an agent
weight 2 · round drawnOllamanone0/10No evidence of any API key/credential scoping, permission model, or least-privilege access control for Ollama's API; docs mention REST API and cloud usage but nothing about issuing scoped credentials.
Jannone0/10No evidence of scoped or least-privilege API credential issuance for agents; Jan exposes a local OpenAI-compatible API server and MCP integration but nothing about credential scoping, permissions, or per-agent access control.
ai-native userBuild against official SDKs
weight 2 · round to OllamaOllama documents official Python and JavaScript/TypeScript SDKs plus a REST API for building applications, with docs pages dedicated to each language and a curl example for the API. Missing for 10: independent hands-on validation of SDK usage, no OpenAPI spec published, and no evidence of official SDKs beyond Python/JS (e.g., Go, other languages).
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [github] “Ollama has a REST API for running and managing models.”
Jannone0/10Jan exposes an OpenAI-compatible local API server (jan-gh-4) but there is no evidence of official first-party SDKs (Python/JS/etc.) for developers to build against, and probes for API/OpenAPI specs return 404s (jan-probe-1, jan-probe-2), indicating no discoverable SDK or API reference.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
ai-native userSubscribe to events via webhooks
weight 2 · round drawnai-native userConnect a coding agent to this product as a working backend
weight 3 · round to OllamaOllama explicitly documents connecting coding agents like Claude Code, Codex, Copilot, and OpenCode to Ollama as a backend via one-command launch and REST API, plus dedicated capacity for running multiple agents concurrently. Missing for 10: independent hands-on confirmation of coding-agent integration specifically (community evidence covers general usability/performance, not agent-backend workflows directly), and no third-party benchmark of agent-mode throughput.
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
- [claimed-docs] “Dedicated capacity so throughput holds up when you are running several agents at once.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Ollama has a REST API for running and managing models.”
Jan exposes a local OpenAI-compatible API server (localhost:1337) that other applications/agents can connect to as a backend, plus MCP integration for agentic capabilities, supporting the story's core claim. Missing for 10: no independent hands-on verification of an agent actually connecting via this backend, no OpenAPI/spec documentation (probe returned 404s), and no detail on API completeness or auth/config for agent use.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
Agentic features
ai-native userDelegate tasks to a built-in AI assistant inside the product
weight 3 · round to JanOllamanone0/10Ollama positions itself as a model runtime that plugs into external agents (Claude Code, Codex, OpenClaw) rather than offering a built-in assistant inside the product itself to which tasks can be delegated. The evidence shows connectivity to third-party agents, not an in-product assistant.
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Use OpenClaw to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more”
Jan supports creating 'Custom Assistants' and has MCP integration for 'agentic capabilities', suggesting task delegation to an in-app assistant, but the evidence lacks detail on how tasks are actually delegated/executed autonomously versus simple chat-based Q&A. Missing for 10: concrete documentation or hands-on demonstration of task delegation/execution flow, independent corroboration of agentic behavior beyond chat.
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [claimed-docs] “Personal Intelligence that answers only to you”
ai-native userOperate the product with natural-language commands
weight 2 · round drawnOllama's own docs and GitHub emphasize connecting it to third-party agents (Claude Code, Codex, OpenClaw, Copilot) that let users issue natural-language commands, and OpenClaw specifically turns Ollama into a chat-driven assistant across Slack/Discord/WhatsApp — but Ollama itself is a CLI/REST-API model runner with structured commands (ollama run/pull), not a natural-language interface to itself. missing for 10: first-party NL command layer for managing Ollama (not just via third-party agents), hands-on evidence that agent-mediated NL control works reliably, independent corroboration beyond vendor docs.
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Use OpenClaw to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more”
- [github] “Ollama has a REST API for running and managing models.”
Jan is a chat-based AI assistant interface where natural-language interaction with models is inherent (custom assistants, model chat), and MCP integration supports agentic natural-language task execution, but there's no evidence of a broader natural-language command interface for controlling app settings/operations beyond chatting with a model. Missing for 10: documented natural-language command capabilities for app control/operations, independent hands-on verification of NL-driven agentic workflows.
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Api quality
ai-native userExplore an interactive API reference with runnable examples
weight 2 · round drawnOllamanone0/10Evidence shows static API docs (REST API description, curl/Python/JS usage examples) but explicit probes for an OpenAPI/Swagger spec and docs.md all returned 404, indicating no interactive, runnable API reference exists.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [probe] “PROBE docs-md: HTTP 404 at https://ollama.com/docs.md”
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
Jannone0/10No evidence of an interactive API reference or runnable examples; probes for llms.txt and openapi/swagger specs all returned 404, and no docs mention an API explorer despite Jan exposing a local OpenAI-compatible server.
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)
weight 2 · round to JanOllamanone0/10Ollama documents a REST API but the probe explicitly shows no machine-readable OpenAPI/Swagger spec at any standard location (all candidates 404), and no evidence of an alternative machine-readable spec being offered.
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
Jan exposes an OpenAI-compatible local API server, which implies an OpenAPI-style spec is at least conceptually available since it mirrors OpenAI's documented API, but there's no evidence of an actual downloadable OpenAPI/swagger file — probes for openapi.json/swagger.json all returned 404. missing for 10: a documented, downloadable OpenAPI spec file or endpoint, explicit API reference docs describing endpoints/schemas.
ai-native userRely on versioned APIs with a documented deprecation policy
weight 2 · round drawnOllamanone0/10There is no evidence of API versioning scheme or a documented deprecation policy; OpenAPI/spec probes returned 404s and docs only describe basic REST endpoints without version numbers or lifecycle guarantees.
Jannone0/10There is no evidence of any versioning scheme or deprecation policy for Jan's OpenAI-compatible API; probes for OpenAPI specs and llms.txt both returned 404, and no docs mention API versioning.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
Automation depth — how much of the product can run unattendedAutomation depth
How much of the product can run unattended
ai-native userPerform bulk operations across many items at once
weight 2 · round drawnOllamanone0/10Ollama is a local/cloud model runner with a REST API and CLI for single-model interactions (pull, run, rm, hotswap), but there's no evidence of bulk operations across many items (e.g., batch inference over a list of prompts/files, bulk model management operations) as a supported workflow.
Ecosystem — integrations, plugins, and third-party ecosystem storiesEcosystem
Integrations, plugins, and third-party ecosystem stories
Build and install
developerBuild the runtime from source with minimal external dependencies
weight 2 · round to JanOllamanone0/10The evidence pack contains no documentation or discussion of building Ollama from source, its build system, or its dependency footprint; community comments only touch on runtime usage, ROCm support, and comparisons to llama.cpp, not compilation from source.
Jan-gh-7 indicates a build script that 'installs dependencies, builds core components, and launches the app,' implying a build-from-source path, but there's no detail on minimal external dependencies, build instructions, or platform requirements. missing for 10: explicit build documentation, dependency list/count, minimal-dependency claims, independent verification of build success.
- [github] “This handles everything: installs dependencies, builds core components, and launches the app.”
developerRun the runtime inside a container for reproducible deployment
weight 2 · round to OllamaOnly indirect evidence exists: a community comment notes Ollama has shipped ROCm containers since v0.1.27, implying official container images exist, but there is no first-party documentation of a Docker image, docker run command, or containerized deployment guidance in the evidence pack. Missing for 10: official Docker Hub/registry image docs, docker-compose or Kubernetes deployment examples, and independent confirmation of reproducible container usage.
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
developerInstall the runtime quickly using a standard package manager
weight 1 · round drawnOllamanone0/10The evidence pack contains no mention of installing Ollama via a standard package manager (e.g., brew, apt, winget) or any specific install command; only vague community remarks about general ease-of-use exist, not installation method details.
Jannone0/10Jan is a desktop app installed via installers/build scripts (jan-gh-7 references installing dependencies and building core components, not a package manager install), with no evidence of npm/pip/brew/apt-style package manager installation for a runtime. missing for 10: evidence of installation via a standard package manager (e.g., brew, npm, apt, winget) rather than a manual build/installer process.
- [github] “This handles everything: installs dependencies, builds core components, and launches the app.”
developerInstall using prebuilt binaries or packages instead of compiling from source
weight 2 · round to OllamaCommunity evidence (native macOS/Windows app, 'ollama pull' installs, ease of use praise) implies prebuilt binaries/packages are the standard install path, but no evidence pack item explicitly documents a downloads page, package manager support (brew/apt/winget), or install script. missing for 10: explicit docs/citation of prebuilt binary downloads or package manager installation instructions, confirmation of no-compile-required install across OSes.
- [community] “So cool! I have been using Ollama for weeks now and I just love it! Easiest way to run local LLMs, we are actually embedding them into our p…”
- [community] “Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…”
- [community] “Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …”
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
Jannone0/10Evidence only shows a build-from-source script ('installs dependencies, builds core components, and launches the app') rather than prebuilt binaries or packages; no mention of downloadable installers, .deb/.exe/.dmg packages, or package manager availability.
- [github] “This handles everything: installs dependencies, builds core components, and launches the app.”
Community contribution
developerContribute code and become a recognized collaborator through the project's open-source process
weight 1 · round drawnOllamanone0/10The evidence pack contains no mention of a CONTRIBUTING guide, PR/review process, contributor recognition, or governance structure for Ollama's GitHub project. While the project is open source, nothing here documents how a developer becomes a recognized collaborator; some community comments even criticize Ollama for minimizing attribution to upstream contributors (llama.cpp), but this doesn't constitute evidence of a functioning contributor path either way.
Language bindings
developerCall the runtime from official client libraries in languages like Python or JavaScript
weight 2 · round to OllamaOfficial docs explicitly document using Ollama from Python and from JavaScript/TypeScript, plus a REST API underlying these clients. Missing for 10: independent hands-on developer confirmation of the Python/JS client libraries specifically (community evidence covers CLI/GUI usage, not the client libraries), and no versioning/package details (e.g., PyPI/npm links) in the pack.
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
Jan exposes an OpenAI-compatible local API server at localhost:1337 which could be called from Python/JS via standard OpenAI SDKs, but there is no evidence of official Jan-branded client libraries in Python or JavaScript, no SDK docs, and probes for openapi/llms.txt endpoints returned 404s. missing for 10: official Python/JS client libraries, SDK documentation, published API reference/OpenAPI spec, independent confirmation of SDK usage.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
Licensing and cost
power-userWhether commercial or enterprise use requires a paid license or subscription beyond the free community edition
weight 2 · round drawnOllamanone0/10No evidence pack items address licensing terms, commercial/enterprise use restrictions, or pricing tiers beyond the free community edition; the pack only covers technical features, cloud usage, and community sentiment.
Jannone0/10No evidence in the pack addresses licensing terms, commercial use, or enterprise pricing for Jan; all citations focus on features and technical capabilities. This is an applicable axis for an open-source product since buyers commonly need to know if commercial use triggers different licensing, but no such information is provided.
Maintenance health
developerHow quickly the project ships patches for critical bugs and security vulnerabilities based on its public release history
weight 2 · round drawnOllamanone0/10No evidence in the pack addresses release cadence, security patch turnaround, CVE history, or public release notes for Ollama; all citations concern features, docs, or general user sentiment. missing for 10: release history/changelog data, CVE/security advisory response times, patch cadence documentation.
Model portability
developerWhether downloaded model files and caches can be reused by other runtimes without re-downloading or re-converting them
weight 2 · round drawnOllamanone0/10No vendor documentation claims that Ollama's downloaded model files/cache are interoperable with other runtimes; in fact community evidence explicitly states Ollama uses a proprietary registry format with hashed filenames that don't work with other tools, indicating models are not reusable without re-downloading/conversion.
- [community] “Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …”
Jannone0/10No evidence describes Jan's model storage format, cache location, or compatibility with other runtimes (e.g., Ollama, LM Studio, llama.cpp shared GGUF caches). The evidence only covers downloading models from HuggingFace and running them locally, with no mention of cache reuse or interoperability across tools.
Privacy control
power-userRun inference entirely on my own machine so my data and prompts never leave my device
weight 3 · round drawnOllama's core design is local model execution with an explicit claim that locally-run data never leaves the device, and multiple community posts confirm running full inference locally on personal hardware (Mac, AMD GPU) with no network dependency. Missing for 10: independent audit/proof of no telemetry when running locally, and clearer separation from the optional cloud mode which could confuse the 'never leaves device' guarantee for casual users.
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “So cool! I have been using Ollama for weeks now and I just love it! Easiest way to run local LLMs, we are actually embedding them into our p…”
- [community] “Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…”
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
Jan supports downloading and running local LLMs entirely on-device with full control and privacy, plus a local OpenAI-compatible API server, corroborated by first-party docs/GitHub and community mentions. Missing for 10: independent hands-on verification of complete offline operation with no telemetry/network calls, and clearer documentation on data handling guarantees.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
- [claimed-docs] “Personal Intelligence that answers only to you”
- [community] “I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.”
Model support — which models run and how well — coverage, formats, update cadenceModel support
Which models run and how well — coverage, formats, update cadence
Architecture coverage
developerRun hundreds of different model architectures including LLMs, MoE, multi-modal, and embedding models
weight 3 · round drawnCommunity evidence confirms Ollama can run varied model types—multimodal (comm-18), MoE-style models like qwen3.5-a3b (comm-3), and newer architectures like Gemma4 (gh-3)—but there's no first-party documentation enumerating hundreds of supported architectures or explicit embedding-model support in this pack. Missing for 10: official docs listing supported model architecture breadth/count, explicit embedding-model examples, and independent benchmarks across LLM/MoE/multimodal/embedding categories.
- [community] “I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…”
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
- [github] “Run and chat with [Gemma 4](https://ollama.com/library/gemma4):”
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
Jan documents running LLMs (Llama, Gemma, Qwen, GPT-oss) from HuggingFace and connecting to cloud models, but there is no evidence of specific support for MoE architectures, multi-modal models, or embedding models. Missing for 10: explicit MoE model support, multi-modal (vision/audio) model support, embedding model support, and independent verification of breadth ('hundreds' of architectures).
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
developerServe embedding models for retrieval and search applications
weight 2 · round drawnOllamanone0/10The evidence pack contains no mention of embedding models, an embeddings API endpoint, or retrieval/search use cases—only general model-serving, coding-agent integration, and REST API references. Absence of evidence for this applicable capability means it cannot be credited as delivered based on this pack.
Jannone0/10Evidence pack covers LLM chat models, cloud integrations, assistants, MCP, and an OpenAI-compatible API server, but nowhere mentions embedding model support or endpoints for retrieval/search use cases. Missing for 10: any mention of embedding model downloads, an /embeddings API endpoint, or retrieval/vector-search integration.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Custom assistants
power-userCreate specialized custom assistants configured for specific tasks
weight 2 · round to JanOllamanone0/10The evidence pack covers model pulling, swapping, REST/API access, and connecting Ollama to external coding agents, but contains no mention of Modelfiles, system-prompt customization, or an 'ollama create' style workflow that would let a power-user build and save a specialized persona/assistant configuration.
GitHub README explicitly lists 'Custom Assistants: Create specialized AI assistants for your tasks' as a feature, directly matching the story, but there is no further documentation detail (configuration options, persona/system prompt setup, task-specific tooling) or independent hands-on corroboration of this feature. Missing for 10: detailed docs on assistant configuration, independent/hands-on verification, examples of specialized task setups.
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
Hybrid cloud local
power-userConnect to cloud AI providers alongside local models within the same interface
weight 2 · round to JanOllama Cloud lets users run larger models in the cloud via the same CLI/API and base-URL pattern used for local models, and docs explicitly describe local vs cloud base URLs and dedicated cloud capacity alongside local execution. However, this is Ollama's own hosted cloud (not third-party providers like OpenAI/Anthropic APIs), and there's no independent/hands-on corroboration of seamless local+cloud interchangeability. Missing for 10: evidence of connecting to external third-party cloud providers, and community confirmation the unified interface works smoothly in practice.
- [claimed-docs] “Run larger models on Ollama's Cloud without the download.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Dedicated capacity so throughput holds up when you are running several agents at once.”
- [claimed-docs] “Frontier capability with more usage. The latest open models match the best closed ones, at a fraction of the cost.”
- [probe] “PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…”
Jan explicitly supports running local models alongside cloud providers (OpenAI, Anthropic, Mistral, Groq, MiniMax) within the same interface, corroborated by docs and GitHub README. Missing for 10: independent hands-on verification of simultaneous cloud+local usage in one session, and detailed UI walkthrough of switching between providers.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
power-userOffload very large models to a hosted cloud tier without downloading them when my local hardware is insufficient
weight 1 · round to OllamaOllama's docs explicitly advertise running larger models on Ollama's Cloud 'without the download,' with dedicated capacity for throughput and cloud/local base URLs for API access, directly matching the story. Missing for 10: independent hands-on benchmarks or reviews confirming cloud offload works reliably, and details on pricing/limits/model catalog for the cloud tier.
- [claimed-docs] “Run larger models on Ollama's Cloud without the download.”
- [claimed-docs] “Dedicated capacity so throughput holds up when you are running several agents at once.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Frontier capability with more usage. The latest open models match the best closed ones, at a fraction of the cost.”
Jannone0/10Jan's cloud integration lets users connect to third-party hosted APIs (OpenAI, Claude, etc.) for chat, but there is no evidence of a 'hosted cloud tier' offload feature where Jan itself runs large local-style models remotely on a user's behalf — this is just a client connecting to external providers' own APIs, not an offload service tied to insufficient local hardware.
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
power-userThe pricing tiers, rate limits, and usage caps that apply when offloading inference to the vendor's hosted cloud tier
weight 2 · round drawnOllamanone0/10Evidence mentions Ollama Cloud exists (dedicated capacity, run larger models without download) but nowhere specifies pricing tiers, rate limits, or usage caps for the hosted cloud offering.
Jannone0/10Jan connects to third-party cloud providers (OpenAI, Anthropic, etc.) but there is no evidence of Jan itself documenting pricing tiers, rate limits, or usage caps for a hosted cloud tier — the evidence only shows connectivity, not vendor pricing/limits disclosure. missing for 10: any documentation of pricing tiers, rate limits, or usage caps for cloud inference offload.
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Model hub download
power-userDownload and run open models directly from Hugging Face
weight 3 · round to JanCommunity evidence confirms users pull models 'on HF or Ollama registry' via 'ollama pull', indicating HF-hosted model support, but there's no first-party documentation in the pack detailing the HF integration, supported formats, or any workflow specifics. Missing for 10: official docs/API reference for Hugging Face model pulling, examples of the exact command syntax, and independent hands-on verification beyond a single forum comment.
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
Jan explicitly documents downloading and running open models (Llama, Gemma, Qwen, GPT-oss, etc.) directly from Hugging Face with local privacy/control, which directly matches the story. Missing for 10: independent hands-on verification of the HF download flow and more detail on model format/quantization support.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Multi modal support
power-userRun vision-language models that understand images alongside text
weight 2 · round to OllamaOnly indirect evidence exists: a community comment confirms Ollama's app supports multimodal (image+text) interaction as expected, but there is no first-party documentation enumerating vision-language model support, image API usage, or specific VLM models (e.g., llava, bakllava) in this evidence pack. Missing for 10: official docs on vision model support, API examples for image inputs, and broader hands-on corroboration of VLM performance/quality.
- [community] “I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…”
- [github] “Run and chat with [Gemma 4](https://ollama.com/library/gemma4):”
Openness — open source, data portability, and self-hosting storiesOpenness
Open source, data portability, and self-hosting stories
ai-native userDo everything through the API that I can do in the UI
weight 2 · round to OllamaOllama exposes a REST API for running and managing models (ollama-gh-4) and documents curl/Python/JS usage (ollama-docs-9/10/11), suggesting core model operations (pull, run, chat) are API-accessible, matching much of the CLI/GUI functionality. However, there is no explicit documentation or comparison confirming full parity between the desktop app/UI and the API, and no OpenAPI spec was found (ollama-probe-3), leaving completeness unverified. missing for 10: explicit UI-to-API feature parity documentation, OpenAPI/spec confirming full endpoint coverage, and evidence that newer GUI-only features (e.g. app settings) are also exposed via API.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
Jan exposes an OpenAI-compatible local API server for chat/model interactions, but there's no evidence that UI-only features like custom assistant creation, MCP integration setup, or model downloading/management are exposed via that API — and probes found no published OpenAPI spec confirming API completeness. missing for 10: documented API coverage for assistants/MCP/model management, published OpenAPI schema, independent confirmation that API parity with UI exists.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
ai-native userExport all of my data in open formats and leave
weight 3 · round to OllamaOllamadisputedcontradicted3/10Ollama's docs emphasize that local data 'never leaves your machine' and prompts aren't tracked, implying user data ownership, but there's no documented export feature for models/configs/chats in open formats. A community report explicitly describes Ollama's model registry as using a proprietary hashed-filename format incompatible with other tools, directly undermining any implied openness/portability. missing for 10: explicit data-export tooling, documented open-format model/config storage, independent confirmation that files are portable to other runtimes.
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [community] “Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …”
Jannone0/10No evidence of a data export feature (chat history, settings, assistants) in open formats; evidence only covers model downloading, cloud integration, API server, and MCP support, none of which address exporting user data. Missing for 10: documented export/backup function, open format (e.g. JSON/Markdown) specification, and any confirmation of data portability upon leaving the product.
ai-native userRead the product's source under an open license
weight 2 · round drawnThe GitHub repo (ollama/ollama) is publicly listed and referenced multiple times, implying the source is readable, but the evidence pack never cites an explicit license file or statement confirming an OSI-approved open license. Community comments also raise concerns about opaque registry formats and minimal attribution to llama.cpp, suggesting the project's openness culture is contested even if the code repo itself is public. Missing for 10: explicit license text/citation (e.g., LICENSE file, OSI license name), and independent confirmation that all core source (not just docs) is open.
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Ollama has a REST API for running and managing models.”
- [community] “Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …”
- [community] “There's a thing somewhat conspicuous in its absence - why isn't llama.cpp more directly credited and thanked for providing the base technolo…”
Jan is hosted on GitHub (janhq/jan) with build instructions implying source availability, but the evidence pack lacks any explicit mention of the license type (e.g., AGPL/MIT/Apache) to confirm it's open source. Missing for 10: explicit license file/name, confirmation of OSI-approved license, and independent corroboration of license terms.
ai-native userSelf-host the core product
weight 3 · round drawnOllama is fundamentally a local-first, self-hosted LLM runtime — docs state 'nothing you run locally ever leaves your machine' and prompts are never tracked, while extensive community evidence confirms real self-hosted use across macOS, Linux, and AMD GPUs (ROCm containers) for weeks/months. GitHub also exposes a REST API for self-managed model serving. missing for 10: dedicated self-host installation/deployment docs (Docker, systemd, resource sizing) and resolution of community complaints about restricted server config (mlock) that limit full self-host control
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [github] “Ollama has a REST API for running and managing models.”
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…”
- [community] “Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …”
- [community] “Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…”
Jan is a locally-run desktop app that runs models fully on-device with privacy/control, builds from source (installs dependencies, builds core components, launches app), and exposes a local OpenAI-compatible API server — all consistent with self-hosting the core product. missing for 10: independent hands-on confirmation of self-hosted deployment (e.g., Docker/server install instructions) and clearer documentation of multi-user/server-mode self-hosting beyond single-user desktop use.
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [github] “This handles everything: installs dependencies, builds core components, and launches the app.”
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [claimed-docs] “Personal Intelligence that answers only to you”
Performance hardware — raw speed and hardware efficiency — throughput, latency, resource usePerformance hardware
Raw speed and hardware efficiency — throughput, latency, resource use
Distributed serving
developerDistribute inference across multiple GPUs using tensor, pipeline, or data parallelism
weight 2 · round drawnOllamanone0/10No evidence in the pack addresses multi-GPU tensor, pipeline, or data parallelism distribution; documentation and community notes focus on model management, single-machine inference, ROCm support issues, and app UX rather than distributed inference strategies.
Gpu acceleration
developerRun inference on specialized accelerators like TPUs or Gaudi through plugin support
weight 1 · round drawnOllamanone0/10Evidence only covers CPU/CUDA/ROCm (AMD) GPU support; there is no mention of TPU, Gaudi, or any plugin/accelerator-extension mechanism for specialized hardware.
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
power-userRun models larger than my available VRAM using combined CPU+GPU offload
weight 3 · round drawnOllamanone0/10The axis clearly applies to a local-inference tool like Ollama, but no evidence in the pack documents or discusses CPU+GPU hybrid offload for models exceeding VRAM; comments only mention ROCm GPU detection issues and fallback to full CPU (not partial offload).
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
Jannone0/10No evidence pack item mentions GPU/CPU offload, VRAM limits, or hybrid inference settings; only generic local model running and download capabilities are documented. Missing for 10: any mention of CPU+GPU hybrid offload, VRAM-exceeding model support, or configuration options for split inference.
power-userWhy GPU acceleration failed and silently fell back to CPU through clear diagnostic output
weight 1 · round to OllamaCommunity logs show Ollama does emit a specific diagnostic line ('no suitable rocm found, falling back to CPU') when ROCm isn't detected, which is real evidence of some diagnostic output on GPU fallback. However, other reports (e.g., slow Mistral performance on Mac) show cases where users experience silent CPU fallback with no clear diagnostic explanation, and there is no first-party documentation describing or guaranteeing such diagnostics across backends. Missing for 10: official docs on GPU-fallback diagnostics, consistency of the diagnostic message across CUDA/Metal/ROCm paths, and confirmation that the message reaches typical CLI/API users rather than just verbose logs.
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
- [community] “Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…”
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
power-userRun models on NVIDIA, AMD, or other GPU vendors using vendor-specific acceleration kernels
weight 3 · round to OllamaCommunity evidence confirms Ollama ships ROCm containers for AMD GPUs and users report running it on AMD RX 6650 hardware, and separate benchmarks show it running on Apple Silicon (Metal/mlx) with measured tokens/sec; however other evidence documents cases where ROCm detection fails and inference silently falls back to CPU, showing reliability caveats in vendor-specific acceleration. No explicit evidence in the pack confirms NVIDIA CUDA kernel acceleration specifically. missing for 10: explicit NVIDIA CUDA acceleration evidence, and confirmation that vendor detection/fallback issues (e.g. ROCm not found) are resolved.
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
- [community] “Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.”
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
Jannone0/10No evidence in the pack mentions GPU vendor support (NVIDIA CUDA, AMD ROCm, Vulkan, etc.) or vendor-specific acceleration kernels; only generic local model running and cloud integration are documented. Missing for 10: any mention of GPU backend selection, NVIDIA/AMD/Intel acceleration support, or benchmarks showing multi-vendor GPU usage.
power-userAccelerate inference on AMD GPUs via a Vulkan backend without needing a full ROCm install
weight 2 · round drawnOllamanone0/10Evidence only shows Ollama supporting ROCm (AMD GPU) containers, with one user even reporting Ollama fell back to CPU when ROCm library was missing — no mention anywhere of a Vulkan backend as a ROCm-free alternative for AMD acceleration.
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
Memory management
power-userControl how context memory is allocated when running multiple model instances concurrently
weight 2 · round drawnOllamanone0/10The evidence pack contains no documentation of controls for allocating context memory across concurrent model instances (no mention of parallel request limits, per-model memory reservation, or context-window tuning). In fact, community evidence directly says Ollama hides server configuration and won't let users control memory locking/allocation in favor of fixed 'sane defaults' (ollama-comm-13), and hotswap is mentioned only as a convenience feature, not a memory-control mechanism (ollama-comm-4).
- [community] “What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
Jannone0/10No evidence describes controlling context memory allocation across multiple concurrent model instances; evidence only covers model downloading, cloud integration, custom assistants, API server, and MCP support. Missing for 10: any documentation of memory/VRAM allocation controls, concurrent instance management, or per-instance context size configuration.
Platform acceleration
power-userGet accelerated inference on Apple Silicon via native ARM and Metal optimizations
weight 3 · round to OllamaCommunity reports suggest Ollama recently moved toward native MLX support on Apple Silicon ("better memory handling") and a benchmark shows respectable tokens/sec on an M4 Pro, but there is no first-party documentation citing Metal/ARM optimizations, and another user reports very slow inference on a MacBook Pro versus LM Studio. Missing for 10: vendor docs describing Metal/ARM-specific acceleration, consistent independent benchmarks confirming speedups over CPU/non-native baselines, resolution of the conflicting slow-performance report.
- [community] “Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.”
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
- [community] “Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…”
developerRun inference on diverse CPU architectures beyond x86 and ARM, such as PowerPC
weight 1 · round drawnOllamanone0/10No evidence pack mentions PowerPC or any non-x86/ARM CPU architecture support; discussion is limited to macOS, Linux, Windows on standard x86/ARM/GPU hardware.
power-userLeverage advanced x86 CPU instruction sets like AVX, AVX2, AVX512, and AMX for faster inference
weight 2 · round drawnOllamanone0/10No evidence in the pack mentions AVX, AVX2, AVX512, AMX, or any x86-specific CPU instruction set optimizations; the evidence focuses on model management, cloud/agent integrations, and GPU (ROCm) support.
Startup footprint
power-userGet a fast cold start from a lightweight runtime binary instead of waiting seconds before inference begins
weight 2 · round drawnOllamanone0/10The evidence pack contains no vendor documentation or benchmarks about binary size, startup latency, or cold-start time for Ollama's runtime; the only directly relevant hands-on report describes the opposite experience — slow response with 'just a few tokens a second' and a long wait before output begins on a Mac. There is no substantiation that Ollama achieves a fast cold start from a lightweight binary.
- [community] “Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…”
- [community] “amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…”
Jannone0/10No evidence in the pack discusses runtime binary size, startup time, or cold-start performance; evidence only covers feature capabilities like model downloading, cloud integration, and MCP. missing for 10: benchmark data on cold-start latency, comparison of binary size/runtime footprint, any performance claims about startup time.
Throughput optimization
power-userAchieve high serving throughput via continuous batching and chunked prefill
weight 3 · round drawnOllamanone0/10The evidence pack contains no mention of continuous batching, chunked prefill, or throughput-oriented serving architecture; discussions center on ease of use, model management, and platform support, not serving performance internals. missing for 10: any documentation or benchmark of continuous batching, chunked prefill, or multi-request throughput optimization.
Jannone0/10Jan is a local desktop LLM client focused on running single-user chat sessions and providing an OpenAI-compatible API endpoint; there is no evidence of continuous batching, chunked prefill, or any serving-throughput optimization features aimed at power-users. Missing for 10: any mention of batching/prefill scheduling, throughput benchmarks, or multi-request concurrency handling.
developerRely on paged memory management for attention key/value cache to maximize concurrent request capacity without memory fragmentation
weight 2 · round drawnOllamanone0/10No evidence in the pack mentions PagedAttention, paged KV cache, or any concurrent-request memory management design for Ollama; discussions focus on model management, hotswapping, and general performance complaints rather than KV cache paging.
Jannone0/10No evidence in the pack mentions paged attention, KV cache management, or memory fragmentation optimizations for concurrent requests; Jan is presented as a personal local LLM app without server-scale inference engine details. This axis is applicable to any LLM-serving tool but Jan's evidence pack contains nothing addressing it, so it must be judged 'none'.
power-userThe runtime reserves dedicated capacity so throughput holds steady when multiple agents or sessions issue requests concurrently
weight 2 · round to OllamaOllama's marketing page explicitly claims 'Dedicated capacity so throughput holds up when you are running several agents at once' (ollama-docs-4), directly matching the story, but this refers to Ollama's paid Cloud service, not the local runtime itself, and there is no independent or hands-on evidence corroborating that this reserved capacity actually holds steady under concurrent multi-agent load. missing for 10: independent benchmarks or hands-on verification of concurrent throughput stability, technical details on how capacity is reserved/allocated, and confirmation this applies to the self-hosted runtime rather than only the hosted cloud tier.
- [claimed-docs] “Dedicated capacity so throughput holds up when you are running several agents at once.”
- [claimed-docs] “Run larger models on Ollama's Cloud without the download.”
power-userSpeed up repeated-prompt workloads using prefix caching
weight 2 · round drawnOllamanone0/10No evidence in the pack mentions prefix caching, prompt caching, or reuse of KV-cache across repeated prompts; docs cover model switching, cloud, and APIs but not this performance feature.
power-userAccelerate generation speed using speculative decoding techniques
weight 2 · round drawnOllamanone0/10No evidence in the pack mentions speculative decoding or any similar draft-model acceleration technique in Ollama's docs, GitHub, or community discussion.
Privacy posture — data-handling and privacy storiesPrivacy posture
Data-handling and privacy stories
ai-native userChoose where my data is stored (region/residency)
weight 2 · round drawnOllama's local-only mode keeps data entirely on the user's own machine (never tracked, never leaves device), which effectively gives users full control over data location by self-hosting. However, there is no evidence of an explicit region/residency selection feature for Ollama's Cloud offering, so users of the hosted service cannot pick a data-storage region. Missing for 10: explicit cloud region/residency selection controls, documentation on where cloud-hosted data is stored, and any enterprise data-residency guarantees.
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Run larger models on Ollama's Cloud without the download.”
Jan runs models fully locally, meaning users can keep all data on their own device rather than any vendor cloud, which implicitly gives residency control (jan-gh-1, jan-gh-6, jan-docs-2). However, there is no explicit region-selection feature or documentation for choosing where data is stored when using the optional cloud model integrations (jan-gh-2). Missing for 10: explicit region/residency selection controls for cloud-connected usage, documentation addressing data storage location for hybrid/cloud mode, and independent confirmation of data handling policies.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Personal Intelligence that answers only to you”
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
ai-native userPrevent my data from being used to train AI models
weight 3 · round to OllamaOllama's docs explicitly state prompts are never tracked or trained on, and that data run locally never leaves the machine, directly addressing the training-data privacy concern for local usage. missing for 10: independent/third-party verification of the no-training claim, and clarity on data handling policy for the Cloud offering specifically.
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
Jan runs local models on-device with local data/privacy framing ('full control and privacy', 'Personal Intelligence that answers only to you'), which inherently keeps local usage data out of any training pipeline. However, there's no explicit privacy policy or documented statement about data-training practices for cloud-connected models (OpenAI, Claude, etc.) that users can also plug into, so the story is only partially addressed. Missing for 10: explicit opt-out/data-training policy statement, documentation covering cloud-provider data usage, independent verification of no telemetry/training use.
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Personal Intelligence that answers only to you”
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
ai-native userControl data retention and deletion
weight 2 · round drawnOllama's docs assert local-first privacy ('never tracked or trained on', 'nothing you run locally ever leaves your machine'), which implicitly gives users control since data stays on their own machine, but there is no explicit documentation of retention policies, deletion mechanisms, or how data is handled/deleted when using Ollama Cloud. Missing for 10: explicit retention/deletion policy docs, cloud data handling and deletion controls, any audit or settings UI for managing stored data.
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
- [claimed-docs] “Run larger models on Ollama's Cloud without the download.”
Jan's local-first architecture and 'full control and privacy' messaging imply user data (chats, models) stays on-device and is inherently under user control, but no evidence pack item documents explicit retention settings, data export, or deletion features within the app. missing for 10: explicit in-app data retention/deletion controls, documented data lifecycle policy, independent confirmation of local-only storage behavior.
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Personal Intelligence that answers only to you”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
ai-native userOpt out of telemetry and usage tracking
weight 2 · round to OllamaOllama's docs claim local runs never leave the machine and prompts are never tracked or trained on, implying no telemetry for local usage, but there is no explicit settings/flag documented for opting out of any telemetry (e.g., update checks, cloud usage analytics) and no independent confirmation of a telemetry toggle. missing for 10: explicit opt-out mechanism/config flag for telemetry, documentation on what data (if any) is collected by the app/cloud, independent verification of no telemetry.
- [claimed-docs] “Your prompts are never tracked or trained on.”
- [claimed-docs] “Nothing you run locally ever leaves your machine.”
Jannone0/10No evidence pack items mention telemetry settings, opt-out controls, or usage tracking policy; general privacy marketing phrases ('privacy', 'answers only to you') do not document an actual opt-out mechanism. Missing for 10: explicit telemetry disclosure, a documented opt-out setting/flag, and any confirmation of what data (if any) is collected.
Quantization formats — stories about quantization formats in this arenaQuantization formats
Stories about quantization formats in this arena
Adapters
developerEfficiently serve multiple LoRA adapters on top of a base model
weight 2 · round drawnOllamanone0/10No evidence in the pack mentions LoRA adapters, multi-adapter serving, or adapter-switching capabilities on Ollama; the evidence covers model pulling, hotswapping full models, and general local/cloud serving but never adapter-level composition on a shared base model.
File formats
developerWhether upgrading the runtime can break compatibility with previously downloaded quantized model files
weight 2 · round drawnOllamanone0/10No evidence addresses runtime upgrade compatibility with previously downloaded quantized model files—no changelog, migration guide, or version compatibility notes are present in the pack.
power-userLoad and run models packaged in the GGUF format
weight 3 · round to JanOllamanone0/10The evidence pack never explicitly documents importing or running custom GGUF model files (e.g., via a Modelfile 'FROM ./model.gguf' or 'ollama create'); references to llama.cpp internals and quantization suffixes like q4_K_M only hint at GGUF-based tooling without confirming user-facing GGUF loading support.
Jan is uses llama.cpp backend and advertises downloading and running LLMs (Llama, Gemma, Qwen, etc.) from HuggingFace with full local control, which implies GGUF support since that's the standard format for such local model runners, but no citation explicitly names GGUF format handling or import of custom GGUF files. missing for 10: explicit mention of GGUF format support, guidance on loading custom/local GGUF files, independent hands-on confirmation of GGUF compatibility.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Quantization levels
power-userReduce memory footprint using integer quantization ranging from very low-bit to 8-bit precision
weight 3 · round to OllamaCommunity benchmarking shows Ollama running models at multiple quantization levels (q4_K_M, int4) confirming integer quantization support in practice, but there is no first-party documentation in the pack describing a range of quantization precisions from very low-bit to 8-bit, nor any explicit list of supported quant formats. missing for 10: official docs enumerating supported quant levels (e.g., q2/q3/q4/q5/q8), guidance on choosing quantization for memory savings, and independent benchmarks across the full low-bit to 8-bit range.
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
- [community] “Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.”
developerLoad models quantized in formats like FP8, INT4, GPTQ, or AWQ
weight 2 · round drawnOllamanone0/10Ollama's documented workflow centers on its own GGUF-based model library and quantization variants (e.g., q4_K_M) pulled via 'ollama pull'; the evidence pack shows only informal community benchmarks referencing 'int4' and 'nvfp4' variants, with no documentation or example of loading FP8, GPTQ, or AWQ quantized checkpoints. missing for 10: any docs or examples showing import/support of FP8, INT4 (as a named format), GPTQ, or AWQ quantization schemes, and confirmation these external quant formats can be loaded rather than only Ollama's own GGUF variants.
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
Jannone0/10Evidence only mentions downloading/running LLMs from HuggingFace and general model support, with no mention of specific quantization formats like FP8, INT4, GPTQ, or AWQ. missing for 10: any documentation or mention of FP8, INT4, GPTQ, AWQ or other quantization format support.
Serving api — serving models over an API — endpoints, compatibility, reliabilityServing api
Serving models over an API — endpoints, compatibility, reliability
Api compatibility
developerCall the server through an Anthropic-compatible messages endpoint
weight 1 · round drawnOllamanone0/10No evidence in the pack mentions an Anthropic-compatible /v1/messages endpoint or any Anthropic API compatibility layer; Ollama's documented API is its own REST API and an OpenAI-compatible endpoint is not referenced either. Missing for 10: any mention of Anthropic messages API compatibility, endpoint path, or request/response schema mapping.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
Jannone0/10Jan's local server is explicitly documented as OpenAI-compatible (jan-gh-4), and while it can connect to Anthropic's Claude as a cloud provider (jan-gh-2), there is no evidence of an Anthropic-compatible messages endpoint being served by Jan itself; OpenAPI probes also returned 404.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
developerLaunch a local OpenAI-compatible API server for any loaded model
weight 3 · round to JanOllama's docs and GitHub evidence confirm a local REST API server that developers can query via curl, Python, or JS SDKs (ollama-docs-9, ollama-docs-10, ollama-docs-11, ollama-gh-4), which is the core of an OpenAI-compatible local server story. However, the evidence pack never explicitly states 'OpenAI-compatible' endpoint support, and there's no confirmed OpenAPI spec (ollama-probe-3 shows 404s for openapi/swagger endpoints). Missing for 10: explicit documentation or hands-on confirmation of OpenAI-compatible endpoints (e.g., /v1/chat/completions), and independent verification of drop-in compatibility with OpenAI SDKs.
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [github] “Ollama has a REST API for running and managing models.”
- [probe] “PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…”
Jan's GitHub docs explicitly state it provides an OpenAI-compatible local API server at localhost:1337 for use with other applications, directly matching the story. Missing for 10: independent hands-on verification of the server (probes for openapi/llms.txt returned 404, and no third-party confirmation of usage exists in the pack).
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
Deployment modes
developerRun the runtime headlessly with no GUI for use in servers or CI pipelines
weight 2 · round to OllamaEvidence shows Ollama exposes a REST API and can be driven via curl, Python, and JS/TS (ollama-gh-4, ollama-docs-9/10/11), and community reports confirm it running as a background/server process on Linux and inside Docker/ROCm containers without any GUI (ollama-comm-16, ollama-comm-9, ollama-comm-13). However there is no explicit documentation of a dedicated 'serve' headless mode, CI-pipeline examples, or systemd/Docker deployment guide in the pack. missing for 10: explicit CI/pipeline docs, dedicated headless-serve documentation, first-party Docker/CI examples.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [community] “Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …”
- [community] “It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…”
- [community] “What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…”
Jannone0/10Jan is described as a desktop app with a GUI that exposes a local OpenAI-compatible API server (jan-gh-4), but there is no evidence of a headless mode, CLI-only server invocation, or CI/server deployment path without the GUI.
Generation controls
developerStream generated tokens back to my application as they are produced
weight 3 · round to JanOllamanone0/10The evidence pack describes Ollama's REST API, curl usage, and Python/JS client libraries but never explicitly documents streaming token output as a capability; no mention of stream=true, chunked responses, or any developer discussion of receiving tokens incrementally. Missing for 10: explicit docs or examples showing streamed token responses, SDK streaming usage, or community confirmation of streaming behavior.
- [claimed-docs] “Learn the local and cloud base URLs, then send a request with curl.”
- [claimed-docs] “Use Ollama from Python.”
- [claimed-docs] “Use Ollama from JavaScript or TypeScript.”
- [github] “Ollama has a REST API for running and managing models.”
Jan exposes an OpenAI-compatible local API server (localhost:1337), and OpenAI-compatible APIs conventionally support streaming, but the evidence pack never explicitly documents streaming token output as a feature; probes for API/OpenAPI specs also returned 404s, leaving this unconfirmed. Missing for 10: explicit documentation or hands-on confirmation of streaming responses, working API spec/reference showing stream parameter support.
developerConstrain model output to structured formats like JSON using grammars
weight 2 · round drawnOllamanone0/10The evidence pack contains no mention of structured output, JSON mode, grammars, or format constraints in Ollama's API despite this being a known capability of the real product; nothing here documents it.
Jannone0/10No evidence pack item mentions grammars, JSON schema constraints, or structured output enforcement; only generic API/server and model integration features are documented. Missing for 10: any mention of grammar-based decoding, JSON mode, or structured output constraints in Jan's local server or API.
developerUse native tool-calling and reasoning-parser support in my requests
weight 2 · round drawnOllamanone0/10The evidence pack mentions Ollama's REST API and its use with coding agents like Claude Code, Codex, and Copilot, but nowhere explicitly documents native tool-calling support or a reasoning-parser feature in the API. Without direct evidence of these specific capabilities, the story cannot be credited as delivered.
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
Jannone0/10Evidence shows Jan offers an OpenAI-compatible local API server and MCP integration for agentic capabilities, but there is no mention of native tool-calling support or reasoning-parser handling in requests; OpenAPI/spec probes also returned 404s, giving no documentation of these specific serving-API features.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
Model lifecycle
developerAssign a custom identifier to a loaded model for consistent reference in API calls
weight 1 · round drawnOllamanone0/10The evidence pack covers model pulling, hotswapping, REST API existence, and cloud/local usage, but nothing describes assigning a custom identifier/alias to a loaded model (e.g., custom model naming via Modelfile or 'ollama cp') for consistent API reference. Missing for 10: any documentation or example of custom model naming/tagging and using that custom name in API calls.
- [github] “Ollama has a REST API for running and managing models.”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
Jannone0/10Evidence shows Jan exposes an OpenAI-compatible local API server but contains no mention of assigning custom identifiers/aliases to loaded models for consistent API reference; probes for API docs even returned 404s.
power-userLoad and switch between multiple models without restarting the server
weight 2 · round to OllamaCommunity hands-on evidence directly confirms hotswapping models without server restarts, backed by simple pull/rm model management via REST API and CLI. missing for 10: first-party docs explicitly describing concurrent model loading/switching mechanics, and independent benchmarks on switch latency.
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
- [github] “Ollama has a REST API for running and managing models.”
Jan supports downloading/running multiple local models and exposes an OpenAI-compatible local server, implying model switching is plausible, but no evidence explicitly documents hot-swapping models without restarting the server. missing for 10: explicit docs/demo of switching loaded models via API without server restart, independent confirmation of this behavior.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Remote serving
power-userServe models over my local network for access from other devices
weight 2 · round to JanOllama exposes a REST API for running/managing models (ollama-gh-4), which in principle could be reached from other devices, but the evidence pack has no explicit documentation of configuring Ollama to bind to a LAN interface (e.g. OLLAMA_HOST) and a community report explicitly notes the official app 'doesn't seem to offer any way to connect to a remote Ollama instance,' undercutting confidence that this is a smooth, first-class workflow. missing for 10: explicit docs on network/LAN binding configuration, first-party guidance for accessing the server from another device, and corroborating hands-on confirmation that remote access works well.
- [github] “Ollama has a REST API for running and managing models.”
- [community] “I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own…”
Jan exposes an OpenAI-compatible local server at localhost:1337 for other applications to connect, which is the core capability needed for local-network serving, but there's no explicit documentation of binding to a network interface (0.0.0.0) or configuring access from other devices on the LAN. missing for 10: explicit network/LAN binding configuration docs, authentication/security guidance for exposing the server beyond localhost, independent confirmation of successful multi-device access.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
Scale limits
developerThe documented maximum concurrent requests or connections the local server can handle before throughput degrades
weight 3 · round drawnOllamanone0/10No documentation of a maximum concurrent request/connection limit or throughput degradation curve is present; evidence only vaguely references 'dedicated capacity' for cloud and REST API existence without concrete numbers or benchmarks tied to concurrency.
Jannone0/10There is evidence Jan runs a local OpenAI-compatible server, but no documentation of maximum concurrent requests/connections or throughput degradation thresholds; probes for API/openapi docs returned 404s.
- [github] “OpenAI-Compatible API: Local server at `localhost:1337` for other applications”
- [probe] “PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt”
- [probe] “PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…”
Server configuration
power-userOverride low-level engine settings like memory locking or mmap behavior instead of being limited to opinionated defaults
weight 2 · round drawnOllamanone0/10No vendor documentation shows exposed low-level engine flags for mmap/mlock; explicit hands-on community feedback states Ollama actively hides such server configs (mlock) in favor of its own defaults, confirming the capability is absent.
- [community] “What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…”
Ux tooling — the working surface itself — layout, ergonomics, quality-of-life toolingUx tooling
The working surface itself — layout, ergonomics, quality-of-life tooling
Ai assisted setup
ai-native userRely on an AI assistant to recommend which local model best fits my hardware and task before I download it
weight 2 · round drawnOllamanone0/10No evidence of any AI assistant or recommendation feature that suggests which local model fits a user's hardware/task before download; the evidence covers model pulling, switching, running, and API/CLI usage but nothing about hardware-aware model recommendations.
Jannone0/10Evidence shows Jan lets users browse/download models from HuggingFace and choose between local or cloud models, but there is no mention of any AI assistant or recommendation engine that suggests which model fits a user's hardware or task before downloading. missing for 10: hardware-detection/benchmarking feature, model-recommendation UI or assistant, any first-party or community mention of such a guidance feature.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Chat interface
power-userChat with local models using a built-in graphical chat interface
weight 3 · round to JanCommunity evidence confirms Ollama shipped a native desktop GUI app (macOS/Windows) that lets users chat with local models, with multimodal and Markdown support working as expected (ollama-comm-16, ollama-comm-18). However, the same evidence shows real caveats: no Linux support, no way to connect to a remote Ollama instance, and some developer pushback that building a GUI is outside Ollama's core mission (ollama-comm-17, ollama-comm-19, ollama-comm-20). Missing for 10: official first-party docs describing the GUI's features, cross-platform (Linux) parity, and independent hands-on reviews beyond a single HN thread.
- [community] “Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …”
- [community] “I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own…”
- [community] “I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…”
- [community] “completely useless move. there are already tons of good clients for Ollama. The Ollama devs need to focus on being a better llama.cpp, not b…”
- [community] “Well, they gotta do what they gotta do. But as a developer, this kills the positioning and trust it had for me. I do not see it as a develop…”
Jan is a desktop app with a built-in GUI for downloading and chatting with local LLMs, corroborated by community mention of using Jan.ai as a chat client alongside OpenWebUI. missing for 10: detailed hands-on screenshots/reviews of the chat UI itself and independent power-user critique of the interface's depth/features.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Download and run LLMs with **full control** and **privacy**.”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
- [claimed-docs] “Personal Intelligence that answers only to you”
- [community] “I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.”
Cli tooling
developerStart an interactive chat session with a model directly from the terminal
weight 2 · round to OllamaGitHub docs explicitly show 'ollama run' used to chat with a model (e.g. 'Run and chat with Gemma 4'), and community benchmarks confirm real-world use of 'ollama run <model> --verbose' for interactive terminal sessions, corroborating the core CLI chat workflow. Missing for 10: a dedicated first-party tutorial on the interactive REPL commands (e.g. /bye, /set) and independent UX review specifically of the chat session experience.
- [github] “Run and chat with [Gemma 4](https://ollama.com/library/gemma4):”
- [community] “User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
Jannone0/10The evidence describes Jan as a desktop GUI app with a local OpenAI-compatible server and MCP integration, but there is no mention of a CLI or terminal-based interactive chat mode. missing for 10: any documentation of a CLI chat command, terminal REPL, or command-line interface for starting a chat session.
developerSearch, download, and manage models from a command-line interface
weight 2 · round to OllamaCommunity evidence strongly confirms CLI-based model search/pull/remove/hotswap workflows (ollama pull, ollama rm, model registry browsing) as core, well-liked functionality, corroborated by multiple independent hands-on accounts. Missing for 10: first-party CLI reference docs in the evidence pack detailing search/list commands, and independent benchmarking of management UX beyond community anecdotes.
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
- [community] “No mention of the fact that Ollama is about 1000x easier to use. Llama.cpp is a great project but one of the least user friendly pieces of s…”
- [github] “Run and chat with [Gemma 4](https://ollama.com/library/gemma4):”
- [github] “Ollama has a REST API for running and managing models.”
- [community] “Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…”
developerLoad a model with custom GPU offload and context length settings from the command line
weight 1 · round drawnOllamanone0/10No evidence in the pack shows Ollama CLI flags for setting GPU offload or context length; the only related community evidence (ollama-comm-13) explicitly complains that Ollama 'hides all the server configs in favor of their own sane defaults' and doesn't expose things like mlock, suggesting limited low-level CLI tuning rather than confirming it.
- [community] “What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…”
Jannone0/10No evidence in the pack mentions a CLI for Jan, let alone CLI flags for GPU offload or context length; evidence only covers GUI-based model download, cloud integration, and local API server. Missing for 10: any mention of a command-line interface, CLI flags for GPU layers/offload, or context-length parameters.
developerStart and stop the local model server from the command line
weight 1 · round to OllamaEvidence shows Ollama runs as a background server process managed via CLI commands (e.g., 'ollama run', 'ollama pull') and a REST API for managing models, with community mentions of not needing to restart the server, but there is no explicit documentation of a dedicated 'ollama serve' start command or an explicit stop/shutdown CLI command. missing for 10: explicit docs for 'ollama serve' start command, explicit CLI stop/kill command, and confirmation these work cross-platform.
- [github] “Ollama has a REST API for running and managing models.”
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
Jannone0/10Evidence confirms Jan runs a local OpenAI-compatible API server at localhost:1337, but there is no mention of a CLI command or terminal interface to start/stop that server — the app appears GUI-driven, with build scripts (jan-gh-7) referring to app launch, not a dedicated server CLI. missing for 10: documented CLI commands (e.g. jan serve/jan stop) or terminal-based start/stop control of the local model server.
developerLaunch popular third-party coding agent CLIs pre-configured to use my local models with a single command
weight 2 · round to OllamaOllama's own docs explicitly state you can 'Launch Claude Code, Codex, and more with one command' pre-configured to use local models, and GitHub docs list direct integration with Claude Code, Codex, Copilot, OpenCode, etc. This directly matches the story, though it rests solely on vendor claims without independent hands-on confirmation of the single-command launch experience. Missing for 10: independent/community verification of the one-command launch flow, and details on how pre-configuration (model selection, API keys) is handled.
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [claimed-docs] “Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.”
Jannone0/10No evidence Jan provides a one-command launcher for third-party coding agent CLIs (e.g., Claude Code, Aider) pre-configured to local models; it only offers a local OpenAI-compatible API server and MCP integration, which developers would need to manually configure themselves.
Document intelligence
ai-native userChat with my own documents entirely offline using automatic retrieval-augmented generation
weight 2 · round drawnOllamanone0/10Ollama provides local model serving and APIs but the evidence shows no built-in RAG/document-chat feature, embeddings pipeline, or automatic retrieval system for chatting with documents; it only supports running models and connecting external agents/tools.
Local model management
power-userManage my downloaded models, saved prompts, and per-model configurations in one place
weight 2 · round to JanEvidence shows straightforward model download/removal/hotswap management (ollama pull/rm) as a core CLI workflow, but there is no evidence of a 'saved prompts' feature or a unified place to manage prompts alongside models, and one community report explicitly says Ollama hides server/per-model configuration options behind fixed defaults rather than exposing them for management. missing for 10: saved-prompt management, a unified UI/CLI view combining models+prompts+configs, and evidence of exposed per-model configuration controls.
- [community] “The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…”
- [community] “I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …”
- [community] “What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…”
Jan supports downloading/running local models and custom assistants, implying some per-model management, but there's no concrete evidence of a unified UI for managing saved prompts or per-model configuration settings in one place. Missing for 10: dedicated prompt-library management, explicit per-model config UI, and independent hands-on confirmation of a unified management view.
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
Not comparable on these axes
ai-native userConnect an agent via an official MCP server
weight 3 · not comparableOllamanone0/10Evidence shows Ollama integrates with coding agents (Claude Code, Codex, etc.) as a backend model provider via REST API, but there is no mention of Ollama shipping an official MCP server that agents could connect to.
- [github] “connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.”
- [github] “Ollama has a REST API for running and managing models.”
- [claimed-docs] “Launch Claude Code, Codex, and more with one command.”
Jann/aJan is itself an AI assistant/agent application (local chat app with model integration), and the MCP evidence (jan-gh-5) describes Jan connecting to MCP servers as a client for agentic capabilities, not Jan exposing itself as an MCP server for other agents to connect to. Per the agent-role rule, serving as an MCP server is a different product role from being an agent, and no evidence shows Jan running an MCP server endpoint (only an OpenAI-compatible API server is documented in jan-gh-4).
ai-native userGet AI-generated insights and suggestions from my data inside the product
weight 2 · not comparableOllaman/aOllama is a local/cloud model-serving runtime and API, not a data application that surfaces AI-generated insights from a user's own data; there is no product surface (dashboards, documents, analytics) into which insights would be embedded. This story applies to data-centric products, not to a model-runner tool like Ollama.
Jannone0/10Evidence shows Jan supports local/cloud LLM chat, custom assistants, and MCP integration, but nothing describes analyzing or surfacing insights from the user's own data inside the product (no RAG, document analysis, or data-insight feature mentioned).
- [github] “Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace”
- [github] “Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others”
- [github] “Custom Assistants: Create specialized AI assistants for your tasks”
- [github] “Model Context Protocol: MCP integration for agentic capabilities”
- [claimed-docs] “Choose from open models or plug in your favorite online models.”
ai-native userSet up automations that run autonomously in the background
weight 2 · not comparableOllaman/aOllama is a local/cloud model-serving runtime with an API, not an automation/orchestration platform; setting up autonomous background automations is outside its product category (though it can be integrated into agents built by others).
ai-native userTest against a sandbox environment without touching production data
weight 1 · not comparableOllaman/aOllama is a local/cloud LLM runtime, not a data platform or SaaS with production data and a sandbox/staging environment concept; the 'sandbox vs production data' framing is a category error for this product type.
ai-native userDefine rules that trigger actions automatically on events
weight 3 · not comparableOllaman/aOllama is a local/cloud model runtime and API server, not a workflow/automation platform; defining event-triggered rules is outside its product category (wrong axis).
ai-native userSchedule recurring jobs or workflows
weight 2 · not comparableOllaman/aOllama is a local/cloud model runtime and API server, not a workflow/job orchestration platform; scheduling recurring jobs is outside its product category and would be handled by external tooling (cron, agents) rather than Ollama itself.
ai-native userVersion, review, and roll back my automations
weight 1 · not comparableOllaman/aOllama is a local/cloud model runtime and API, not an automation/workflow-builder product; versioning, reviewing, and rolling back 'automations' is not an applicable concept for this product category.
developerDisaggregate prefill and decode phases for optimized large-scale serving
weight 1 · not comparableOllaman/aPrefill/decode disaggregation is a large-scale distributed serving optimization (multi-node inference infrastructure) that is entirely outside Ollama's product category as a single-node local/cloud model runner; nothing in the evidence pack even gestures at distributed serving architecture, so this is a category error rather than a missing feature.
ai-native userHave an AI agent draft and edit documents in an integrated workspace with changes saved automatically
weight 1 · not comparableOllaman/aOllama is a local/cloud model runtime and API layer, not a document-editing workspace product; it provides no integrated workspace with autosave for AI-drafted documents. This story is a category error for this product type.
ai-native userDictate speech that gets transcribed in real time by an on-device model
weight 1 · not comparableOllaman/aOllama is a local LLM runtime/serving tool for text (and some multimodal) models; there is no evidence of speech-to-text/dictation or real-time transcription capability, and this is not the product's category — voice dictation is a distinct axis unrelated to running LLMs locally.