Skip to content

Ollama wins · 2613 (43 drawn)

Agenticness — how well agents can access and operate the productAgenticness

How well agents can access and operate the product

Agent access

  1. ai-native userPoint an agent at llms.txt or agent-oriented docs

    weight 2 · round to Ollama
    Ollamafullprobed8/10

    A probe confirms https://ollama.com/llms.txt returns HTTP 200 with structured agent-oriented content describing Ollama and its integrations, directly satisfying the story. Missing for 10: no docs.md or machine-readable OpenAPI spec (both 404), and no independent confirmation of agents actually consuming the llms.txt file.

    • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…
    • [probe] PROBE docs-md: HTTP 404 at https://ollama.com/docs.md
    • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…
    Jannone0/10

    No llms.txt or agent-oriented docs endpoint exists; probes confirm 404 at jan.ai/llms.txt and no openapi/swagger docs found, and no other evidence mentions such docs.

    • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
    • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
  2. ai-native userRun the product headlessly / in CI for automation

    weight 2 · round to Ollama

    Ollama exposes a REST API and can be driven via curl, Python, or JS SDKs (ollama-gh-4, ollama-docs-9/10/11), which supports headless/scriptable use in automation contexts, and community reports confirm running it as a background service for bots/integrations (ollama-comm-4). However, there is no explicit CI documentation, GitHub Actions examples, or dedicated headless-mode/CI guidance in the evidence. Missing for 10: explicit CI/CD pipeline docs or examples, headless server flags/docs, and independent CI usage reports.

    • [github] Ollama has a REST API for running and managing models.
    • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
    • [claimed-docs] Use Ollama from Python.
    • [claimed-docs] Use Ollama from JavaScript or TypeScript.
    • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
    Jannone0/10

    Jan is a desktop GUI app for local AI models; evidence shows a local OpenAI-compatible API server and MCP integration, but there is no evidence of a headless/CLI mode or documented CI automation workflow. missing for 10: headless/CLI launch mode, CI/automation documentation, evidence of running without GUI.

    • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
    • [github] Model Context Protocol: MCP integration for agentic capabilities
    • [github] This handles everything: installs dependencies, builds core components, and launches the app.
  3. ai-native userPlug MCP servers into this product so it can use their tools

    weight 3 · round to Jan
    Ollamanone0/10

    The evidence shows Ollama integrates with external coding agents (Claude Code, Codex, Copilot) as a model backend and exposes a REST API, but there is no evidence that Ollama itself acts as an MCP client that can plug in MCP servers to gain access to their tools. Missing for 10: any mention of MCP protocol support, MCP server configuration, or tool-use via MCP within Ollama itself.

    • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
    • [github] Ollama has a REST API for running and managing models.
    • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
    • [claimed-docs] Launch Claude Code, Codex, and more with one command.

    GitHub docs explicitly list 'Model Context Protocol: MCP integration for agentic capabilities' as a feature, confirming the product supports plugging in MCP servers for tool use. However, there's no detailed documentation on setup, configuration, or independent hands-on confirmation of this working. Missing for 10: detailed first-party docs on MCP server configuration, independent/community corroboration of MCP tool usage in practice.

    • [github] Model Context Protocol: MCP integration for agentic capabilities
  4. ai-native userUse an official CLI

    weight 2 · round to Ollama

    Ollama ships an official CLI ('ollama run', 'ollama pull', 'ollama rm', etc.) that is widely used and repeatedly confirmed in community evidence for model management, hotswapping, and launching agents like Claude Code/Codex with one command, making it a core agentic workflow tool. Missing for 10: no first-party CLI reference docs excerpt in the pack and no independent benchmark of CLI-specific agent orchestration beyond community anecdotes.

    • [claimed-docs] Launch Claude Code, Codex, and more with one command.
    • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
    • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
    • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
    • [community] No mention of the fact that Ollama is about 1000x easier to use. Llama.cpp is a great project but one of the least user friendly pieces of s…
    Jannone0/10

    No evidence of an official CLI tool for Jan; evidence mentions a desktop app, local API server, and build script but nothing about a dedicated CLI for AI-native workflows. Missing for 10: any documentation or reference to a CLI product/binary, its command set, or usage examples.

    • ai-native userDrive the product through a documented public API

      weight 3 · round to Ollama
      Ollamafullprobed8/10

      Ollama documents a REST API for running/managing models, with SDKs for Python and JS/TS, curl examples, and base URLs for local/cloud, plus community confirmation of wide integration with agents and tools. Missing for 10: a formal OpenAPI/Swagger spec (probe shows 404s) and independent third-party validation of API completeness.

      • [github] Ollama has a REST API for running and managing models.
      • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
      • [claimed-docs] Use Ollama from Python.
      • [claimed-docs] Use Ollama from JavaScript or TypeScript.
      • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
      • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…
      • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…

      Jan exposes an OpenAI-compatible local API server (localhost:1337) that lets other applications drive it programmatically, which is a documented public API surface. However, probes found no discoverable OpenAPI/swagger spec or llms.txt, suggesting the API documentation is not comprehensively published or easily discoverable. Missing for 10: a formal published OpenAPI/swagger schema, hosted API reference docs, and independent confirmation of API completeness/versioning.

      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
      • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
      • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
    • ai-native userIssue scoped/least-privilege API credentials for an agent

      weight 2 · round drawn
      Ollamanone0/10

      No evidence of any API key/credential scoping, permission model, or least-privilege access control for Ollama's API; docs mention REST API and cloud usage but nothing about issuing scoped credentials.

        Jannone0/10

        No evidence of scoped or least-privilege API credential issuance for agents; Jan exposes a local OpenAI-compatible API server and MCP integration but nothing about credential scoping, permissions, or per-agent access control.

        • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
        • [github] Model Context Protocol: MCP integration for agentic capabilities
      • ai-native userBuild against official SDKs

        weight 2 · round to Ollama
        Ollamafullclaimed7/10

        Ollama documents official Python and JavaScript/TypeScript SDKs plus a REST API for building applications, with docs pages dedicated to each language and a curl example for the API. Missing for 10: independent hands-on validation of SDK usage, no OpenAPI spec published, and no evidence of official SDKs beyond Python/JS (e.g., Go, other languages).

        • [claimed-docs] Use Ollama from Python.
        • [claimed-docs] Use Ollama from JavaScript or TypeScript.
        • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
        • [github] Ollama has a REST API for running and managing models.
        Jannone0/10

        Jan exposes an OpenAI-compatible local API server (jan-gh-4) but there is no evidence of official first-party SDKs (Python/JS/etc.) for developers to build against, and probes for API/OpenAPI specs return 404s (jan-probe-1, jan-probe-2), indicating no discoverable SDK or API reference.

        • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
        • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
        • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
      • ai-native userSubscribe to events via webhooks

        weight 2 · round drawn
        Ollamanone0/10

        No evidence of any webhook/event-subscription mechanism in Ollama's docs, GitHub, or community discussion; Ollama exposes a REST API for model management but nothing about outbound event notifications.

        • [github] Ollama has a REST API for running and managing models.
        Jannone0/10

        No evidence of webhook support anywhere in the evidence pack; Jan offers local model APIs, MCP integration, and OpenAI-compatible endpoints, but nothing about subscribing to events via webhooks.

        • ai-native userConnect a coding agent to this product as a working backend

          weight 3 · round to Ollama
          Ollamafullclaimed8/10

          Ollama explicitly documents connecting coding agents like Claude Code, Codex, Copilot, and OpenCode to Ollama as a backend via one-command launch and REST API, plus dedicated capacity for running multiple agents concurrently. Missing for 10: independent hands-on confirmation of coding-agent integration specifically (community evidence covers general usability/performance, not agent-backend workflows directly), and no third-party benchmark of agent-mode throughput.

          • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
          • [claimed-docs] Launch Claude Code, Codex, and more with one command.
          • [claimed-docs] Dedicated capacity so throughput holds up when you are running several agents at once.
          • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
          • [github] Ollama has a REST API for running and managing models.

          Jan exposes a local OpenAI-compatible API server (localhost:1337) that other applications/agents can connect to as a backend, plus MCP integration for agentic capabilities, supporting the story's core claim. Missing for 10: no independent hands-on verification of an agent actually connecting via this backend, no OpenAPI/spec documentation (probe returned 404s), and no detail on API completeness or auth/config for agent use.

          • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
          • [github] Model Context Protocol: MCP integration for agentic capabilities
          • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…

        Agentic features

        1. ai-native userDelegate tasks to a built-in AI assistant inside the product

          weight 3 · round to Jan
          Ollamanone0/10

          Ollama positions itself as a model runtime that plugs into external agents (Claude Code, Codex, OpenClaw) rather than offering a built-in assistant inside the product itself to which tasks can be delegated. The evidence shows connectivity to third-party agents, not an in-product assistant.

          • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
          • [claimed-docs] Launch Claude Code, Codex, and more with one command.
          • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
          • [github] Use OpenClaw to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more

          Jan supports creating 'Custom Assistants' and has MCP integration for 'agentic capabilities', suggesting task delegation to an in-app assistant, but the evidence lacks detail on how tasks are actually delegated/executed autonomously versus simple chat-based Q&A. Missing for 10: concrete documentation or hands-on demonstration of task delegation/execution flow, independent corroboration of agentic behavior beyond chat.

          • [github] Custom Assistants: Create specialized AI assistants for your tasks
          • [github] Model Context Protocol: MCP integration for agentic capabilities
          • [claimed-docs] Personal Intelligence that answers only to you
        2. ai-native userOperate the product with natural-language commands

          weight 2 · round drawn
          Ollamapartialclaimed5/10

          Ollama's own docs and GitHub emphasize connecting it to third-party agents (Claude Code, Codex, OpenClaw, Copilot) that let users issue natural-language commands, and OpenClaw specifically turns Ollama into a chat-driven assistant across Slack/Discord/WhatsApp — but Ollama itself is a CLI/REST-API model runner with structured commands (ollama run/pull), not a natural-language interface to itself. missing for 10: first-party NL command layer for managing Ollama (not just via third-party agents), hands-on evidence that agent-mediated NL control works reliably, independent corroboration beyond vendor docs.

          • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
          • [claimed-docs] Launch Claude Code, Codex, and more with one command.
          • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
          • [github] Use OpenClaw to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more
          • [github] Ollama has a REST API for running and managing models.

          Jan is a chat-based AI assistant interface where natural-language interaction with models is inherent (custom assistants, model chat), and MCP integration supports agentic natural-language task execution, but there's no evidence of a broader natural-language command interface for controlling app settings/operations beyond chatting with a model. Missing for 10: documented natural-language command capabilities for app control/operations, independent hands-on verification of NL-driven agentic workflows.

          • [github] Custom Assistants: Create specialized AI assistants for your tasks
          • [github] Model Context Protocol: MCP integration for agentic capabilities
          • [claimed-docs] Choose from open models or plug in your favorite online models.

        Api quality

        1. ai-native userExplore an interactive API reference with runnable examples

          weight 2 · round drawn
          Ollamanone0/10

          Evidence shows static API docs (REST API description, curl/Python/JS usage examples) but explicit probes for an OpenAPI/Swagger spec and docs.md all returned 404, indicating no interactive, runnable API reference exists.

          • [github] Ollama has a REST API for running and managing models.
          • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
          • [claimed-docs] Use Ollama from Python.
          • [claimed-docs] Use Ollama from JavaScript or TypeScript.
          • [probe] PROBE docs-md: HTTP 404 at https://ollama.com/docs.md
          • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…
          Jannone0/10

          No evidence of an interactive API reference or runnable examples; probes for llms.txt and openapi/swagger specs all returned 404, and no docs mention an API explorer despite Jan exposing a local OpenAI-compatible server.

          • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
          • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
          • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
        2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

          weight 2 · round to Jan
          Ollamanone0/10

          Ollama documents a REST API but the probe explicitly shows no machine-readable OpenAPI/Swagger spec at any standard location (all candidates 404), and no evidence of an alternative machine-readable spec being offered.

          • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…
          • [github] Ollama has a REST API for running and managing models.
          • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.

          Jan exposes an OpenAI-compatible local API server, which implies an OpenAPI-style spec is at least conceptually available since it mirrors OpenAI's documented API, but there's no evidence of an actual downloadable OpenAPI/swagger file — probes for openapi.json/swagger.json all returned 404. missing for 10: a documented, downloadable OpenAPI spec file or endpoint, explicit API reference docs describing endpoints/schemas.

          • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
          • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
        3. ai-native userRely on versioned APIs with a documented deprecation policy

          weight 2 · round drawn
          Ollamanone0/10

          There is no evidence of API versioning scheme or a documented deprecation policy; OpenAPI/spec probes returned 404s and docs only describe basic REST endpoints without version numbers or lifecycle guarantees.

          • [github] Ollama has a REST API for running and managing models.
          • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…
          • [probe] PROBE docs-md: HTTP 404 at https://ollama.com/docs.md
          Jannone0/10

          There is no evidence of any versioning scheme or deprecation policy for Jan's OpenAI-compatible API; probes for OpenAPI specs and llms.txt both returned 404, and no docs mention API versioning.

          • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
          • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
          • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…

        Automation depth — how much of the product can run unattendedAutomation depth

        How much of the product can run unattended

        1. ai-native userPerform bulk operations across many items at once

          weight 2 · round drawn
          Ollamanone0/10

          Ollama is a local/cloud model runner with a REST API and CLI for single-model interactions (pull, run, rm, hotswap), but there's no evidence of bulk operations across many items (e.g., batch inference over a list of prompts/files, bulk model management operations) as a supported workflow.

            Jannone0/10

            No evidence describes any bulk operation capability across multiple items (e.g., batch processing, bulk model downloads, bulk file/chat operations); evidence only covers single-model chat, cloud integration, MCP, and API server basics.

            Ecosystem — integrations, plugins, and third-party ecosystem storiesEcosystem

            Integrations, plugins, and third-party ecosystem stories

            Build and install

            1. developerBuild the runtime from source with minimal external dependencies

              weight 2 · round to Jan
              Ollamanone0/10

              The evidence pack contains no documentation or discussion of building Ollama from source, its build system, or its dependency footprint; community comments only touch on runtime usage, ROCm support, and comparisons to llama.cpp, not compilation from source.

                Jan-gh-7 indicates a build script that 'installs dependencies, builds core components, and launches the app,' implying a build-from-source path, but there's no detail on minimal external dependencies, build instructions, or platform requirements. missing for 10: explicit build documentation, dependency list/count, minimal-dependency claims, independent verification of build success.

                • [github] This handles everything: installs dependencies, builds core components, and launches the app.
              • developerRun the runtime inside a container for reproducible deployment

                weight 2 · round to Ollama

                Only indirect evidence exists: a community comment notes Ollama has shipped ROCm containers since v0.1.27, implying official container images exist, but there is no first-party documentation of a Docker image, docker run command, or containerized deployment guidance in the evidence pack. Missing for 10: official Docker Hub/registry image docs, docker-compose or Kubernetes deployment examples, and independent confirmation of reproducible container usage.

                • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                Jannone0/10

                No evidence of a Docker/container image, containerized deployment guide, or reproducible-deployment support for Jan; evidence only covers desktop app install, local model running, and API server on localhost.

                • developerInstall the runtime quickly using a standard package manager

                  weight 1 · round drawn
                  Ollamanone0/10

                  The evidence pack contains no mention of installing Ollama via a standard package manager (e.g., brew, apt, winget) or any specific install command; only vague community remarks about general ease-of-use exist, not installation method details.

                    Jannone0/10

                    Jan is a desktop app installed via installers/build scripts (jan-gh-7 references installing dependencies and building core components, not a package manager install), with no evidence of npm/pip/brew/apt-style package manager installation for a runtime. missing for 10: evidence of installation via a standard package manager (e.g., brew, npm, apt, winget) rather than a manual build/installer process.

                    • [github] This handles everything: installs dependencies, builds core components, and launches the app.
                  • developerInstall using prebuilt binaries or packages instead of compiling from source

                    weight 2 · round to Ollama
                    Ollamapartialprobed5/10

                    Community evidence (native macOS/Windows app, 'ollama pull' installs, ease of use praise) implies prebuilt binaries/packages are the standard install path, but no evidence pack item explicitly documents a downloads page, package manager support (brew/apt/winget), or install script. missing for 10: explicit docs/citation of prebuilt binary downloads or package manager installation instructions, confirmation of no-compile-required install across OSes.

                    • [community] So cool! I have been using Ollama for weeks now and I just love it! Easiest way to run local LLMs, we are actually embedding them into our p…
                    • [community] Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…
                    • [community] Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …
                    • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…
                    Jannone0/10

                    Evidence only shows a build-from-source script ('installs dependencies, builds core components, and launches the app') rather than prebuilt binaries or packages; no mention of downloadable installers, .deb/.exe/.dmg packages, or package manager availability.

                    • [github] This handles everything: installs dependencies, builds core components, and launches the app.

                  Community contribution

                  1. developerContribute code and become a recognized collaborator through the project's open-source process

                    weight 1 · round drawn
                    Ollamanone0/10

                    The evidence pack contains no mention of a CONTRIBUTING guide, PR/review process, contributor recognition, or governance structure for Ollama's GitHub project. While the project is open source, nothing here documents how a developer becomes a recognized collaborator; some community comments even criticize Ollama for minimizing attribution to upstream contributors (llama.cpp), but this doesn't constitute evidence of a functioning contributor path either way.

                      Jannone0/10

                      Jan is an open-source GitHub project (janhq/jan) so contribution is plausible, but the evidence pack contains no mention of contributing guidelines, CONTRIBUTING.md, PR process, contributor recognition, or community governance — only build instructions and feature descriptions.

                      Language bindings

                      1. developerCall the runtime from official client libraries in languages like Python or JavaScript

                        weight 2 · round to Ollama
                        Ollamafullclaimed8/10

                        Official docs explicitly document using Ollama from Python and from JavaScript/TypeScript, plus a REST API underlying these clients. Missing for 10: independent hands-on developer confirmation of the Python/JS client libraries specifically (community evidence covers CLI/GUI usage, not the client libraries), and no versioning/package details (e.g., PyPI/npm links) in the pack.

                        • [claimed-docs] Use Ollama from Python.
                        • [claimed-docs] Use Ollama from JavaScript or TypeScript.
                        • [github] Ollama has a REST API for running and managing models.
                        • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.

                        Jan exposes an OpenAI-compatible local API server at localhost:1337 which could be called from Python/JS via standard OpenAI SDKs, but there is no evidence of official Jan-branded client libraries in Python or JavaScript, no SDK docs, and probes for openapi/llms.txt endpoints returned 404s. missing for 10: official Python/JS client libraries, SDK documentation, published API reference/OpenAPI spec, independent confirmation of SDK usage.

                        • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                        • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
                        • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…

                      Licensing and cost

                      1. power-userWhether commercial or enterprise use requires a paid license or subscription beyond the free community edition

                        weight 2 · round drawn
                        Ollamanone0/10

                        No evidence pack items address licensing terms, commercial/enterprise use restrictions, or pricing tiers beyond the free community edition; the pack only covers technical features, cloud usage, and community sentiment.

                          Jannone0/10

                          No evidence in the pack addresses licensing terms, commercial use, or enterprise pricing for Jan; all citations focus on features and technical capabilities. This is an applicable axis for an open-source product since buyers commonly need to know if commercial use triggers different licensing, but no such information is provided.

                          Maintenance health

                          1. developerHow quickly the project ships patches for critical bugs and security vulnerabilities based on its public release history

                            weight 2 · round drawn
                            Ollamanone0/10

                            No evidence in the pack addresses release cadence, security patch turnaround, CVE history, or public release notes for Ollama; all citations concern features, docs, or general user sentiment. missing for 10: release history/changelog data, CVE/security advisory response times, patch cadence documentation.

                              Jannone0/10

                              No evidence in the pack discusses release cadence, security patch history, CVE fixes, or changelog frequency for Jan.

                              Model portability

                              1. developerWhether downloaded model files and caches can be reused by other runtimes without re-downloading or re-converting them

                                weight 2 · round drawn
                                Ollamanone0/10

                                No vendor documentation claims that Ollama's downloaded model files/cache are interoperable with other runtimes; in fact community evidence explicitly states Ollama uses a proprietary registry format with hashed filenames that don't work with other tools, indicating models are not reusable without re-downloading/conversion.

                                • [community] Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …
                                Jannone0/10

                                No evidence describes Jan's model storage format, cache location, or compatibility with other runtimes (e.g., Ollama, LM Studio, llama.cpp shared GGUF caches). The evidence only covers downloading models from HuggingFace and running them locally, with no mention of cache reuse or interoperability across tools.

                                • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                • [github] Download and run LLMs with **full control** and **privacy**.

                              Privacy control

                              1. power-userRun inference entirely on my own machine so my data and prompts never leave my device

                                weight 3 · round drawn
                                Ollamafullprobed8/10

                                Ollama's core design is local model execution with an explicit claim that locally-run data never leaves the device, and multiple community posts confirm running full inference locally on personal hardware (Mac, AMD GPU) with no network dependency. Missing for 10: independent audit/proof of no telemetry when running locally, and clearer separation from the optional cloud mode which could confuse the 'never leaves device' guarantee for casual users.

                                • [claimed-docs] Nothing you run locally ever leaves your machine.
                                • [claimed-docs] Your prompts are never tracked or trained on.
                                • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                • [community] So cool! I have been using Ollama for weeks now and I just love it! Easiest way to run local LLMs, we are actually embedding them into our p…
                                • [community] Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…
                                • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…

                                Jan supports downloading and running local LLMs entirely on-device with full control and privacy, plus a local OpenAI-compatible API server, corroborated by first-party docs/GitHub and community mentions. Missing for 10: independent hands-on verification of complete offline operation with no telemetry/network calls, and clearer documentation on data handling guarantees.

                                • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                • [github] Download and run LLMs with **full control** and **privacy**.
                                • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                • [claimed-docs] Choose from open models or plug in your favorite online models.
                                • [claimed-docs] Personal Intelligence that answers only to you
                                • [community] I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.

                              Model support — which models run and how well — coverage, formats, update cadenceModel support

                              Which models run and how well — coverage, formats, update cadence

                              Architecture coverage

                              1. developerRun hundreds of different model architectures including LLMs, MoE, multi-modal, and embedding models

                                weight 3 · round drawn
                                Ollamapartialprobed5/10

                                Community evidence confirms Ollama can run varied model types—multimodal (comm-18), MoE-style models like qwen3.5-a3b (comm-3), and newer architectures like Gemma4 (gh-3)—but there's no first-party documentation enumerating hundreds of supported architectures or explicit embedding-model support in this pack. Missing for 10: official docs listing supported model architecture breadth/count, explicit embedding-model examples, and independent benchmarks across LLM/MoE/multimodal/embedding categories.

                                • [community] I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…
                                • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                • [github] Run and chat with [Gemma 4](https://ollama.com/library/gemma4):
                                • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…

                                Jan documents running LLMs (Llama, Gemma, Qwen, GPT-oss) from HuggingFace and connecting to cloud models, but there is no evidence of specific support for MoE architectures, multi-modal models, or embedding models. Missing for 10: explicit MoE model support, multi-modal (vision/audio) model support, embedding model support, and independent verification of breadth ('hundreds' of architectures).

                                • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                • [github] Download and run LLMs with **full control** and **privacy**.
                                • [claimed-docs] Choose from open models or plug in your favorite online models.
                              2. developerServe embedding models for retrieval and search applications

                                weight 2 · round drawn
                                Ollamanone0/10

                                The evidence pack contains no mention of embedding models, an embeddings API endpoint, or retrieval/search use cases—only general model-serving, coding-agent integration, and REST API references. Absence of evidence for this applicable capability means it cannot be credited as delivered based on this pack.

                                  Jannone0/10

                                  Evidence pack covers LLM chat models, cloud integrations, assistants, MCP, and an OpenAI-compatible API server, but nowhere mentions embedding model support or endpoints for retrieval/search use cases. Missing for 10: any mention of embedding model downloads, an /embeddings API endpoint, or retrieval/vector-search integration.

                                  • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                  • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                  • [claimed-docs] Choose from open models or plug in your favorite online models.

                                Custom assistants

                                1. power-userCreate specialized custom assistants configured for specific tasks

                                  weight 2 · round to Jan
                                  Ollamanone0/10

                                  The evidence pack covers model pulling, swapping, REST/API access, and connecting Ollama to external coding agents, but contains no mention of Modelfiles, system-prompt customization, or an 'ollama create' style workflow that would let a power-user build and save a specialized persona/assistant configuration.

                                    GitHub README explicitly lists 'Custom Assistants: Create specialized AI assistants for your tasks' as a feature, directly matching the story, but there is no further documentation detail (configuration options, persona/system prompt setup, task-specific tooling) or independent hands-on corroboration of this feature. Missing for 10: detailed docs on assistant configuration, independent/hands-on verification, examples of specialized task setups.

                                    • [github] Custom Assistants: Create specialized AI assistants for your tasks

                                  Hybrid cloud local

                                  1. power-userConnect to cloud AI providers alongside local models within the same interface

                                    weight 2 · round to Jan
                                    Ollamapartialprobed6/10

                                    Ollama Cloud lets users run larger models in the cloud via the same CLI/API and base-URL pattern used for local models, and docs explicitly describe local vs cloud base URLs and dedicated cloud capacity alongside local execution. However, this is Ollama's own hosted cloud (not third-party providers like OpenAI/Anthropic APIs), and there's no independent/hands-on corroboration of seamless local+cloud interchangeability. Missing for 10: evidence of connecting to external third-party cloud providers, and community confirmation the unified interface works smoothly in practice.

                                    • [claimed-docs] Run larger models on Ollama's Cloud without the download.
                                    • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                    • [claimed-docs] Dedicated capacity so throughput holds up when you are running several agents at once.
                                    • [claimed-docs] Frontier capability with more usage. The latest open models match the best closed ones, at a fraction of the cost.
                                    • [probe] PROBE llms.txt: HTTP 200 at https://ollama.com/llms.txt # Ollama > Ollama is the easiest way to run open AI models locally or in the cloud,…

                                    Jan explicitly supports running local models alongside cloud providers (OpenAI, Anthropic, Mistral, Groq, MiniMax) within the same interface, corroborated by docs and GitHub README. Missing for 10: independent hands-on verification of simultaneous cloud+local usage in one session, and detailed UI walkthrough of switching between providers.

                                    • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                    • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                    • [claimed-docs] Choose from open models or plug in your favorite online models.
                                  2. power-userOffload very large models to a hosted cloud tier without downloading them when my local hardware is insufficient

                                    weight 1 · round to Ollama
                                    Ollamafullclaimed7/10

                                    Ollama's docs explicitly advertise running larger models on Ollama's Cloud 'without the download,' with dedicated capacity for throughput and cloud/local base URLs for API access, directly matching the story. Missing for 10: independent hands-on benchmarks or reviews confirming cloud offload works reliably, and details on pricing/limits/model catalog for the cloud tier.

                                    • [claimed-docs] Run larger models on Ollama's Cloud without the download.
                                    • [claimed-docs] Dedicated capacity so throughput holds up when you are running several agents at once.
                                    • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                    • [claimed-docs] Frontier capability with more usage. The latest open models match the best closed ones, at a fraction of the cost.
                                    Jannone0/10

                                    Jan's cloud integration lets users connect to third-party hosted APIs (OpenAI, Claude, etc.) for chat, but there is no evidence of a 'hosted cloud tier' offload feature where Jan itself runs large local-style models remotely on a user's behalf — this is just a client connecting to external providers' own APIs, not an offload service tied to insufficient local hardware.

                                    • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                    • [claimed-docs] Choose from open models or plug in your favorite online models.
                                  3. power-userThe pricing tiers, rate limits, and usage caps that apply when offloading inference to the vendor's hosted cloud tier

                                    weight 2 · round drawn
                                    Ollamanone0/10

                                    Evidence mentions Ollama Cloud exists (dedicated capacity, run larger models without download) but nowhere specifies pricing tiers, rate limits, or usage caps for the hosted cloud offering.

                                      Jannone0/10

                                      Jan connects to third-party cloud providers (OpenAI, Anthropic, etc.) but there is no evidence of Jan itself documenting pricing tiers, rate limits, or usage caps for a hosted cloud tier — the evidence only shows connectivity, not vendor pricing/limits disclosure. missing for 10: any documentation of pricing tiers, rate limits, or usage caps for cloud inference offload.

                                      • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                      • [claimed-docs] Choose from open models or plug in your favorite online models.

                                    Model hub download

                                    1. power-userDownload and run open models directly from Hugging Face

                                      weight 3 · round to Jan

                                      Community evidence confirms users pull models 'on HF or Ollama registry' via 'ollama pull', indicating HF-hosted model support, but there's no first-party documentation in the pack detailing the HF integration, supported formats, or any workflow specifics. Missing for 10: official docs/API reference for Hugging Face model pulling, examples of the exact command syntax, and independent hands-on verification beyond a single forum comment.

                                      • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …

                                      Jan explicitly documents downloading and running open models (Llama, Gemma, Qwen, GPT-oss, etc.) directly from Hugging Face with local privacy/control, which directly matches the story. Missing for 10: independent hands-on verification of the HF download flow and more detail on model format/quantization support.

                                      • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                      • [github] Download and run LLMs with **full control** and **privacy**.
                                      • [claimed-docs] Choose from open models or plug in your favorite online models.

                                    Multi modal support

                                    1. power-userRun vision-language models that understand images alongside text

                                      weight 2 · round to Ollama

                                      Only indirect evidence exists: a community comment confirms Ollama's app supports multimodal (image+text) interaction as expected, but there is no first-party documentation enumerating vision-language model support, image API usage, or specific VLM models (e.g., llava, bakllava) in this evidence pack. Missing for 10: official docs on vision model support, API examples for image inputs, and broader hands-on corroboration of VLM performance/quality.

                                      • [community] I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…
                                      • [github] Run and chat with [Gemma 4](https://ollama.com/library/gemma4):
                                      Jannone0/10

                                      No evidence pack item mentions vision-language models, image input, or multimodal capabilities; listed models (Llama, Gemma, Qwen, GPT-oss) are referenced only as text LLMs. Missing for 10: any mention of VLM support, image understanding, or multimodal chat UI/API.

                                      Openness — open source, data portability, and self-hosting storiesOpenness

                                      Open source, data portability, and self-hosting stories

                                      1. ai-native userDo everything through the API that I can do in the UI

                                        weight 2 · round to Ollama
                                        Ollamapartialprobed5/10

                                        Ollama exposes a REST API for running and managing models (ollama-gh-4) and documents curl/Python/JS usage (ollama-docs-9/10/11), suggesting core model operations (pull, run, chat) are API-accessible, matching much of the CLI/GUI functionality. However, there is no explicit documentation or comparison confirming full parity between the desktop app/UI and the API, and no OpenAPI spec was found (ollama-probe-3), leaving completeness unverified. missing for 10: explicit UI-to-API feature parity documentation, OpenAPI/spec confirming full endpoint coverage, and evidence that newer GUI-only features (e.g. app settings) are also exposed via API.

                                        • [github] Ollama has a REST API for running and managing models.
                                        • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                        • [claimed-docs] Use Ollama from Python.
                                        • [claimed-docs] Use Ollama from JavaScript or TypeScript.
                                        • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…

                                        Jan exposes an OpenAI-compatible local API server for chat/model interactions, but there's no evidence that UI-only features like custom assistant creation, MCP integration setup, or model downloading/management are exposed via that API — and probes found no published OpenAPI spec confirming API completeness. missing for 10: documented API coverage for assistants/MCP/model management, published OpenAPI schema, independent confirmation that API parity with UI exists.

                                        • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                        • [github] Custom Assistants: Create specialized AI assistants for your tasks
                                        • [github] Model Context Protocol: MCP integration for agentic capabilities
                                        • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
                                        • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
                                      2. ai-native userExport all of my data in open formats and leave

                                        weight 3 · round to Ollama

                                        Ollama's docs emphasize that local data 'never leaves your machine' and prompts aren't tracked, implying user data ownership, but there's no documented export feature for models/configs/chats in open formats. A community report explicitly describes Ollama's model registry as using a proprietary hashed-filename format incompatible with other tools, directly undermining any implied openness/portability. missing for 10: explicit data-export tooling, documented open-format model/config storage, independent confirmation that files are portable to other runtimes.

                                        • [claimed-docs] Nothing you run locally ever leaves your machine.
                                        • [claimed-docs] Your prompts are never tracked or trained on.
                                        • [community] Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …
                                        Jannone0/10

                                        No evidence of a data export feature (chat history, settings, assistants) in open formats; evidence only covers model downloading, cloud integration, API server, and MCP support, none of which address exporting user data. Missing for 10: documented export/backup function, open format (e.g. JSON/Markdown) specification, and any confirmation of data portability upon leaving the product.

                                        • ai-native userRead the product's source under an open license

                                          weight 2 · round drawn

                                          The GitHub repo (ollama/ollama) is publicly listed and referenced multiple times, implying the source is readable, but the evidence pack never cites an explicit license file or statement confirming an OSI-approved open license. Community comments also raise concerns about opaque registry formats and minimal attribution to llama.cpp, suggesting the project's openness culture is contested even if the code repo itself is public. Missing for 10: explicit license text/citation (e.g., LICENSE file, OSI license name), and independent confirmation that all core source (not just docs) is open.

                                          • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
                                          • [github] Ollama has a REST API for running and managing models.
                                          • [community] Claims Ollama creates lock-in via a proprietary model registry format with hashed filenames that don't work with other tools, and minimizes …
                                          • [community] There's a thing somewhat conspicuous in its absence - why isn't llama.cpp more directly credited and thanked for providing the base technolo…

                                          Jan is hosted on GitHub (janhq/jan) with build instructions implying source availability, but the evidence pack lacks any explicit mention of the license type (e.g., AGPL/MIT/Apache) to confirm it's open source. Missing for 10: explicit license file/name, confirmation of OSI-approved license, and independent corroboration of license terms.

                                          • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                          • [github] This handles everything: installs dependencies, builds core components, and launches the app.
                                        • ai-native userSelf-host the core product

                                          weight 3 · round drawn

                                          Ollama is fundamentally a local-first, self-hosted LLM runtime — docs state 'nothing you run locally ever leaves your machine' and prompts are never tracked, while extensive community evidence confirms real self-hosted use across macOS, Linux, and AMD GPUs (ROCm containers) for weeks/months. GitHub also exposes a REST API for self-managed model serving. missing for 10: dedicated self-host installation/deployment docs (Docker, systemd, resource sizing) and resolution of community complaints about restricted server config (mlock) that limit full self-host control

                                          • [claimed-docs] Nothing you run locally ever leaves your machine.
                                          • [claimed-docs] Your prompts are never tracked or trained on.
                                          • [github] Ollama has a REST API for running and managing models.
                                          • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                          • [community] Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…
                                          • [community] Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …
                                          • [community] Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…

                                          Jan is a locally-run desktop app that runs models fully on-device with privacy/control, builds from source (installs dependencies, builds core components, launches app), and exposes a local OpenAI-compatible API server — all consistent with self-hosting the core product. missing for 10: independent hands-on confirmation of self-hosted deployment (e.g., Docker/server install instructions) and clearer documentation of multi-user/server-mode self-hosting beyond single-user desktop use.

                                          • [github] Download and run LLMs with **full control** and **privacy**.
                                          • [github] This handles everything: installs dependencies, builds core components, and launches the app.
                                          • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                          • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                          • [claimed-docs] Personal Intelligence that answers only to you

                                        Performance hardware — raw speed and hardware efficiency — throughput, latency, resource usePerformance hardware

                                        Raw speed and hardware efficiency — throughput, latency, resource use

                                        Distributed serving

                                        1. developerDistribute inference across multiple GPUs using tensor, pipeline, or data parallelism

                                          weight 2 · round drawn
                                          Ollamanone0/10

                                          No evidence in the pack addresses multi-GPU tensor, pipeline, or data parallelism distribution; documentation and community notes focus on model management, single-machine inference, ROCm support issues, and app UX rather than distributed inference strategies.

                                            Jannone0/10

                                            No evidence Jan supports tensor, pipeline, or data parallelism across multiple GPUs; the evidence pack only mentions local model running, cloud integrations, and API access, with no multi-GPU distribution features documented.

                                            Gpu acceleration

                                            1. developerRun inference on specialized accelerators like TPUs or Gaudi through plugin support

                                              weight 1 · round drawn
                                              Ollamanone0/10

                                              Evidence only covers CPU/CUDA/ROCm (AMD) GPU support; there is no mention of TPU, Gaudi, or any plugin/accelerator-extension mechanism for specialized hardware.

                                              • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                              • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                              Jannone0/10

                                              No evidence of TPU, Gaudi, or any specialized accelerator plugin support; evidence only covers CPU/GPU local inference, cloud API integration, and MCP for agentic workflows.

                                              • power-userRun models larger than my available VRAM using combined CPU+GPU offload

                                                weight 3 · round drawn
                                                Ollamanone0/10

                                                The axis clearly applies to a local-inference tool like Ollama, but no evidence in the pack documents or discusses CPU+GPU hybrid offload for models exceeding VRAM; comments only mention ROCm GPU detection issues and fallback to full CPU (not partial offload).

                                                • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                                • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                                Jannone0/10

                                                No evidence pack item mentions GPU/CPU offload, VRAM limits, or hybrid inference settings; only generic local model running and download capabilities are documented. Missing for 10: any mention of CPU+GPU hybrid offload, VRAM-exceeding model support, or configuration options for split inference.

                                                • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                • [github] Download and run LLMs with **full control** and **privacy**.
                                              • power-userWhy GPU acceleration failed and silently fell back to CPU through clear diagnostic output

                                                weight 1 · round to Ollama

                                                Community logs show Ollama does emit a specific diagnostic line ('no suitable rocm found, falling back to CPU') when ROCm isn't detected, which is real evidence of some diagnostic output on GPU fallback. However, other reports (e.g., slow Mistral performance on Mac) show cases where users experience silent CPU fallback with no clear diagnostic explanation, and there is no first-party documentation describing or guaranteeing such diagnostics across backends. Missing for 10: official docs on GPU-fallback diagnostics, consistency of the diagnostic message across CUDA/Metal/ROCm paths, and confirmation that the message reaches typical CLI/API users rather than just verbose logs.

                                                • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                                • [community] Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…
                                                • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                                Jannone0/10

                                                No evidence describes GPU acceleration diagnostics, error messages, or CPU-fallback logging in Jan; the evidence pack only covers general model download/cloud/API features with no mention of GPU/CPU fallback behavior or diagnostics.

                                                • power-userRun models on NVIDIA, AMD, or other GPU vendors using vendor-specific acceleration kernels

                                                  weight 3 · round to Ollama

                                                  Community evidence confirms Ollama ships ROCm containers for AMD GPUs and users report running it on AMD RX 6650 hardware, and separate benchmarks show it running on Apple Silicon (Metal/mlx) with measured tokens/sec; however other evidence documents cases where ROCm detection fails and inference silently falls back to CPU, showing reliability caveats in vendor-specific acceleration. No explicit evidence in the pack confirms NVIDIA CUDA kernel acceleration specifically. missing for 10: explicit NVIDIA CUDA acceleration evidence, and confirmation that vendor detection/fallback issues (e.g. ROCm not found) are resolved.

                                                  • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                                  • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                                  • [community] Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.
                                                  • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                                  Jannone0/10

                                                  No evidence in the pack mentions GPU vendor support (NVIDIA CUDA, AMD ROCm, Vulkan, etc.) or vendor-specific acceleration kernels; only generic local model running and cloud integration are documented. Missing for 10: any mention of GPU backend selection, NVIDIA/AMD/Intel acceleration support, or benchmarks showing multi-vendor GPU usage.

                                                  • power-userAccelerate inference on AMD GPUs via a Vulkan backend without needing a full ROCm install

                                                    weight 2 · round drawn
                                                    Ollamanone0/10

                                                    Evidence only shows Ollama supporting ROCm (AMD GPU) containers, with one user even reporting Ollama fell back to CPU when ROCm library was missing — no mention anywhere of a Vulkan backend as a ROCm-free alternative for AMD acceleration.

                                                    • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                                    • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                                    Jannone0/10

                                                    No evidence in the pack mentions Vulkan backend, AMD GPU acceleration, or avoiding a ROCm install; only generic model-running and API features are documented. missing for 10: any mention of Vulkan backend, AMD GPU support, or ROCm-free acceleration.

                                                    Memory management

                                                    1. power-userControl how context memory is allocated when running multiple model instances concurrently

                                                      weight 2 · round drawn
                                                      Ollamanone0/10

                                                      The evidence pack contains no documentation of controls for allocating context memory across concurrent model instances (no mention of parallel request limits, per-model memory reservation, or context-window tuning). In fact, community evidence directly says Ollama hides server configuration and won't let users control memory locking/allocation in favor of fixed 'sane defaults' (ollama-comm-13), and hotswap is mentioned only as a convenience feature, not a memory-control mechanism (ollama-comm-4).

                                                      • [community] What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…
                                                      • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                      Jannone0/10

                                                      No evidence describes controlling context memory allocation across multiple concurrent model instances; evidence only covers model downloading, cloud integration, custom assistants, API server, and MCP support. Missing for 10: any documentation of memory/VRAM allocation controls, concurrent instance management, or per-instance context size configuration.

                                                      Platform acceleration

                                                      1. power-userGet accelerated inference on Apple Silicon via native ARM and Metal optimizations

                                                        weight 3 · round to Ollama

                                                        Community reports suggest Ollama recently moved toward native MLX support on Apple Silicon ("better memory handling") and a benchmark shows respectable tokens/sec on an M4 Pro, but there is no first-party documentation citing Metal/ARM optimizations, and another user reports very slow inference on a MacBook Pro versus LM Studio. Missing for 10: vendor docs describing Metal/ARM-specific acceleration, consistent independent benchmarks confirming speedups over CPU/non-native baselines, resolution of the conflicting slow-performance report.

                                                        • [community] Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.
                                                        • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                                        • [community] Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…
                                                        Jannone0/10

                                                        No evidence in the pack mentions Apple Silicon, ARM builds, or Metal acceleration specifically; the listed features cover model downloading, cloud integration, and MCP but not hardware-specific optimizations.

                                                        • developerRun inference on diverse CPU architectures beyond x86 and ARM, such as PowerPC

                                                          weight 1 · round drawn
                                                          Ollamanone0/10

                                                          No evidence pack mentions PowerPC or any non-x86/ARM CPU architecture support; discussion is limited to macOS, Linux, Windows on standard x86/ARM/GPU hardware.

                                                            Jannone0/10

                                                            No evidence Jan supports PowerPC or any non-x86/ARM CPU architectures; evidence only covers standard platform support and model download/cloud integration features.

                                                            • power-userLeverage advanced x86 CPU instruction sets like AVX, AVX2, AVX512, and AMX for faster inference

                                                              weight 2 · round drawn
                                                              Ollamanone0/10

                                                              No evidence in the pack mentions AVX, AVX2, AVX512, AMX, or any x86-specific CPU instruction set optimizations; the evidence focuses on model management, cloud/agent integrations, and GPU (ROCm) support.

                                                                Jannone0/10

                                                                No evidence anywhere in the pack mentions CPU instruction set optimizations (AVX/AVX2/AVX512/AMX) or any hardware-acceleration tuning details for Jan's inference engine.

                                                                Startup footprint

                                                                1. power-userGet a fast cold start from a lightweight runtime binary instead of waiting seconds before inference begins

                                                                  weight 2 · round drawn
                                                                  Ollamanone0/10

                                                                  The evidence pack contains no vendor documentation or benchmarks about binary size, startup latency, or cold-start time for Ollama's runtime; the only directly relevant hands-on report describes the opposite experience — slow response with 'just a few tokens a second' and a long wait before output begins on a Mac. There is no substantiation that Ollama achieves a fast cold start from a lightweight binary.

                                                                  • [community] Ollama runs really, really slow on my MBP for Mistral - as in just a few tokens a second and it takes a long while before it starts giving a…
                                                                  • [community] amdgpu detected, but no compatible rocm library found... unable to verify rocm library, will use cpu: no suitable rocm found, falling back t…
                                                                  Jannone0/10

                                                                  No evidence in the pack discusses runtime binary size, startup time, or cold-start performance; evidence only covers feature capabilities like model downloading, cloud integration, and MCP. missing for 10: benchmark data on cold-start latency, comparison of binary size/runtime footprint, any performance claims about startup time.

                                                                  Throughput optimization

                                                                  1. power-userAchieve high serving throughput via continuous batching and chunked prefill

                                                                    weight 3 · round drawn
                                                                    Ollamanone0/10

                                                                    The evidence pack contains no mention of continuous batching, chunked prefill, or throughput-oriented serving architecture; discussions center on ease of use, model management, and platform support, not serving performance internals. missing for 10: any documentation or benchmark of continuous batching, chunked prefill, or multi-request throughput optimization.

                                                                      Jannone0/10

                                                                      Jan is a local desktop LLM client focused on running single-user chat sessions and providing an OpenAI-compatible API endpoint; there is no evidence of continuous batching, chunked prefill, or any serving-throughput optimization features aimed at power-users. Missing for 10: any mention of batching/prefill scheduling, throughput benchmarks, or multi-request concurrency handling.

                                                                      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                      • [github] Download and run LLMs with **full control** and **privacy**.
                                                                    • developerRely on paged memory management for attention key/value cache to maximize concurrent request capacity without memory fragmentation

                                                                      weight 2 · round drawn
                                                                      Ollamanone0/10

                                                                      No evidence in the pack mentions PagedAttention, paged KV cache, or any concurrent-request memory management design for Ollama; discussions focus on model management, hotswapping, and general performance complaints rather than KV cache paging.

                                                                        Jannone0/10

                                                                        No evidence in the pack mentions paged attention, KV cache management, or memory fragmentation optimizations for concurrent requests; Jan is presented as a personal local LLM app without server-scale inference engine details. This axis is applicable to any LLM-serving tool but Jan's evidence pack contains nothing addressing it, so it must be judged 'none'.

                                                                        • power-userThe runtime reserves dedicated capacity so throughput holds steady when multiple agents or sessions issue requests concurrently

                                                                          weight 2 · round to Ollama
                                                                          Ollamapartialclaimed4/10

                                                                          Ollama's marketing page explicitly claims 'Dedicated capacity so throughput holds up when you are running several agents at once' (ollama-docs-4), directly matching the story, but this refers to Ollama's paid Cloud service, not the local runtime itself, and there is no independent or hands-on evidence corroborating that this reserved capacity actually holds steady under concurrent multi-agent load. missing for 10: independent benchmarks or hands-on verification of concurrent throughput stability, technical details on how capacity is reserved/allocated, and confirmation this applies to the self-hosted runtime rather than only the hosted cloud tier.

                                                                          • [claimed-docs] Dedicated capacity so throughput holds up when you are running several agents at once.
                                                                          • [claimed-docs] Run larger models on Ollama's Cloud without the download.
                                                                          Jannone0/10

                                                                          No evidence describes reserved/dedicated capacity, concurrency guarantees, or throughput stability under multi-session load; evidence only covers local model running, cloud connections, and API server existence.

                                                                          • power-userSpeed up repeated-prompt workloads using prefix caching

                                                                            weight 2 · round drawn
                                                                            Ollamanone0/10

                                                                            No evidence in the pack mentions prefix caching, prompt caching, or reuse of KV-cache across repeated prompts; docs cover model switching, cloud, and APIs but not this performance feature.

                                                                              Jannone0/10

                                                                              No evidence in the pack mentions prefix caching, KV-cache reuse, or any performance optimization for repeated prompts; only generic model-running and API features are documented.

                                                                              • power-userAccelerate generation speed using speculative decoding techniques

                                                                                weight 2 · round drawn
                                                                                Ollamanone0/10

                                                                                No evidence in the pack mentions speculative decoding or any similar draft-model acceleration technique in Ollama's docs, GitHub, or community discussion.

                                                                                  Jannone0/10

                                                                                  No evidence in the pack mentions speculative decoding or any acceleration technique of that kind; Jan's evidence covers model downloading, cloud integration, MCP, and API compatibility but nothing about speculative decoding support.

                                                                                  Privacy posture — data-handling and privacy storiesPrivacy posture

                                                                                  Data-handling and privacy stories

                                                                                  1. ai-native userChoose where my data is stored (region/residency)

                                                                                    weight 2 · round drawn
                                                                                    Ollamapartialclaimed4/10

                                                                                    Ollama's local-only mode keeps data entirely on the user's own machine (never tracked, never leaves device), which effectively gives users full control over data location by self-hosting. However, there is no evidence of an explicit region/residency selection feature for Ollama's Cloud offering, so users of the hosted service cannot pick a data-storage region. Missing for 10: explicit cloud region/residency selection controls, documentation on where cloud-hosted data is stored, and any enterprise data-residency guarantees.

                                                                                    • [claimed-docs] Your prompts are never tracked or trained on.
                                                                                    • [claimed-docs] Nothing you run locally ever leaves your machine.
                                                                                    • [claimed-docs] Run larger models on Ollama's Cloud without the download.

                                                                                    Jan runs models fully locally, meaning users can keep all data on their own device rather than any vendor cloud, which implicitly gives residency control (jan-gh-1, jan-gh-6, jan-docs-2). However, there is no explicit region-selection feature or documentation for choosing where data is stored when using the optional cloud model integrations (jan-gh-2). Missing for 10: explicit region/residency selection controls for cloud-connected usage, documentation addressing data storage location for hybrid/cloud mode, and independent confirmation of data handling policies.

                                                                                    • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                    • [github] Download and run LLMs with **full control** and **privacy**.
                                                                                    • [claimed-docs] Personal Intelligence that answers only to you
                                                                                    • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                                                                  2. ai-native userPrevent my data from being used to train AI models

                                                                                    weight 3 · round to Ollama
                                                                                    Ollamafullclaimed7/10

                                                                                    Ollama's docs explicitly state prompts are never tracked or trained on, and that data run locally never leaves the machine, directly addressing the training-data privacy concern for local usage. missing for 10: independent/third-party verification of the no-training claim, and clarity on data handling policy for the Cloud offering specifically.

                                                                                    • [claimed-docs] Your prompts are never tracked or trained on.
                                                                                    • [claimed-docs] Nothing you run locally ever leaves your machine.
                                                                                    • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.

                                                                                    Jan runs local models on-device with local data/privacy framing ('full control and privacy', 'Personal Intelligence that answers only to you'), which inherently keeps local usage data out of any training pipeline. However, there's no explicit privacy policy or documented statement about data-training practices for cloud-connected models (OpenAI, Claude, etc.) that users can also plug into, so the story is only partially addressed. Missing for 10: explicit opt-out/data-training policy statement, documentation covering cloud-provider data usage, independent verification of no telemetry/training use.

                                                                                    • [github] Download and run LLMs with **full control** and **privacy**.
                                                                                    • [claimed-docs] Personal Intelligence that answers only to you
                                                                                    • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                                                                  3. ai-native userControl data retention and deletion

                                                                                    weight 2 · round drawn
                                                                                    Ollamapartialclaimed4/10

                                                                                    Ollama's docs assert local-first privacy ('never tracked or trained on', 'nothing you run locally ever leaves your machine'), which implicitly gives users control since data stays on their own machine, but there is no explicit documentation of retention policies, deletion mechanisms, or how data is handled/deleted when using Ollama Cloud. Missing for 10: explicit retention/deletion policy docs, cloud data handling and deletion controls, any audit or settings UI for managing stored data.

                                                                                    • [claimed-docs] Your prompts are never tracked or trained on.
                                                                                    • [claimed-docs] Nothing you run locally ever leaves your machine.
                                                                                    • [claimed-docs] Run larger models on Ollama's Cloud without the download.

                                                                                    Jan's local-first architecture and 'full control and privacy' messaging imply user data (chats, models) stays on-device and is inherently under user control, but no evidence pack item documents explicit retention settings, data export, or deletion features within the app. missing for 10: explicit in-app data retention/deletion controls, documented data lifecycle policy, independent confirmation of local-only storage behavior.

                                                                                    • [github] Download and run LLMs with **full control** and **privacy**.
                                                                                    • [claimed-docs] Personal Intelligence that answers only to you
                                                                                    • [claimed-docs] Choose from open models or plug in your favorite online models.
                                                                                  4. ai-native userOpt out of telemetry and usage tracking

                                                                                    weight 2 · round to Ollama
                                                                                    Ollamapartialclaimed5/10

                                                                                    Ollama's docs claim local runs never leave the machine and prompts are never tracked or trained on, implying no telemetry for local usage, but there is no explicit settings/flag documented for opting out of any telemetry (e.g., update checks, cloud usage analytics) and no independent confirmation of a telemetry toggle. missing for 10: explicit opt-out mechanism/config flag for telemetry, documentation on what data (if any) is collected by the app/cloud, independent verification of no telemetry.

                                                                                    Jannone0/10

                                                                                    No evidence pack items mention telemetry settings, opt-out controls, or usage tracking policy; general privacy marketing phrases ('privacy', 'answers only to you') do not document an actual opt-out mechanism. Missing for 10: explicit telemetry disclosure, a documented opt-out setting/flag, and any confirmation of what data (if any) is collected.

                                                                                    Quantization formats — stories about quantization formats in this arenaQuantization formats

                                                                                    Stories about quantization formats in this arena

                                                                                    Adapters

                                                                                    1. developerEfficiently serve multiple LoRA adapters on top of a base model

                                                                                      weight 2 · round drawn
                                                                                      Ollamanone0/10

                                                                                      No evidence in the pack mentions LoRA adapters, multi-adapter serving, or adapter-switching capabilities on Ollama; the evidence covers model pulling, hotswapping full models, and general local/cloud serving but never adapter-level composition on a shared base model.

                                                                                        Jannone0/10

                                                                                        No evidence in the pack mentions LoRA adapters, adapter switching, or multi-adapter serving capabilities; Jan is presented as a local LLM runner/chat client with no reference to this feature.

                                                                                        File formats

                                                                                        1. developerWhether upgrading the runtime can break compatibility with previously downloaded quantized model files

                                                                                          weight 2 · round drawn
                                                                                          Ollamanone0/10

                                                                                          No evidence addresses runtime upgrade compatibility with previously downloaded quantized model files—no changelog, migration guide, or version compatibility notes are present in the pack.

                                                                                            Jannone0/10

                                                                                            No evidence in the pack addresses runtime versioning, changelogs, or compatibility guarantees/breakages for previously downloaded quantized model files; the pack only covers general features and dead docs/API probes.

                                                                                            • power-userLoad and run models packaged in the GGUF format

                                                                                              weight 3 · round to Jan
                                                                                              Ollamanone0/10

                                                                                              The evidence pack never explicitly documents importing or running custom GGUF model files (e.g., via a Modelfile 'FROM ./model.gguf' or 'ollama create'); references to llama.cpp internals and quantization suffixes like q4_K_M only hint at GGUF-based tooling without confirming user-facing GGUF loading support.

                                                                                                Jan is uses llama.cpp backend and advertises downloading and running LLMs (Llama, Gemma, Qwen, etc.) from HuggingFace with full local control, which implies GGUF support since that's the standard format for such local model runners, but no citation explicitly names GGUF format handling or import of custom GGUF files. missing for 10: explicit mention of GGUF format support, guidance on loading custom/local GGUF files, independent hands-on confirmation of GGUF compatibility.

                                                                                                • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                • [github] Download and run LLMs with **full control** and **privacy**.
                                                                                                • [claimed-docs] Choose from open models or plug in your favorite online models.

                                                                                              Quantization levels

                                                                                              1. power-userReduce memory footprint using integer quantization ranging from very low-bit to 8-bit precision

                                                                                                weight 3 · round to Ollama

                                                                                                Community benchmarking shows Ollama running models at multiple quantization levels (q4_K_M, int4) confirming integer quantization support in practice, but there is no first-party documentation in the pack describing a range of quantization precisions from very low-bit to 8-bit, nor any explicit list of supported quant formats. missing for 10: official docs enumerating supported quant levels (e.g., q2/q3/q4/q5/q8), guidance on choosing quantization for memory savings, and independent benchmarks across the full low-bit to 8-bit range.

                                                                                                • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                                                                                • [community] Ollama was basically shelling out to llama.cpp on mac before, so native mlx should mean better memory handling on apple silicon.
                                                                                                Jannone0/10

                                                                                                Jan supports running local LLMs (likely GGUF models which use quantization), but no evidence in the pack specifically mentions quantization formats, bit-precision options, or memory footprint reduction via integer quantization.

                                                                                                • developerLoad models quantized in formats like FP8, INT4, GPTQ, or AWQ

                                                                                                  weight 2 · round drawn
                                                                                                  Ollamanone0/10

                                                                                                  Ollama's documented workflow centers on its own GGUF-based model library and quantization variants (e.g., q4_K_M) pulled via 'ollama pull'; the evidence pack shows only informal community benchmarks referencing 'int4' and 'nvfp4' variants, with no documentation or example of loading FP8, GPTQ, or AWQ quantized checkpoints. missing for 10: any docs or examples showing import/support of FP8, INT4 (as a named format), GPTQ, or AWQ quantization schemes, and confirmation these external quant formats can be loaded rather than only Ollama's own GGUF variants.

                                                                                                  • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                                                                                  Jannone0/10

                                                                                                  Evidence only mentions downloading/running LLMs from HuggingFace and general model support, with no mention of specific quantization formats like FP8, INT4, GPTQ, or AWQ. missing for 10: any documentation or mention of FP8, INT4, GPTQ, AWQ or other quantization format support.

                                                                                                  • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                  • [github] Download and run LLMs with **full control** and **privacy**.

                                                                                                Serving api — serving models over an API — endpoints, compatibility, reliabilityServing api

                                                                                                Serving models over an API — endpoints, compatibility, reliability

                                                                                                Api compatibility

                                                                                                1. developerCall the server through an Anthropic-compatible messages endpoint

                                                                                                  weight 1 · round drawn
                                                                                                  Ollamanone0/10

                                                                                                  No evidence in the pack mentions an Anthropic-compatible /v1/messages endpoint or any Anthropic API compatibility layer; Ollama's documented API is its own REST API and an OpenAI-compatible endpoint is not referenced either. Missing for 10: any mention of Anthropic messages API compatibility, endpoint path, or request/response schema mapping.

                                                                                                  • [github] Ollama has a REST API for running and managing models.
                                                                                                  • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                                                                                  Jannone0/10

                                                                                                  Jan's local server is explicitly documented as OpenAI-compatible (jan-gh-4), and while it can connect to Anthropic's Claude as a cloud provider (jan-gh-2), there is no evidence of an Anthropic-compatible messages endpoint being served by Jan itself; OpenAPI probes also returned 404.

                                                                                                  • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                  • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                                                                                  • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
                                                                                                2. developerLaunch a local OpenAI-compatible API server for any loaded model

                                                                                                  weight 3 · round to Jan
                                                                                                  Ollamapartialprobed6/10

                                                                                                  Ollama's docs and GitHub evidence confirm a local REST API server that developers can query via curl, Python, or JS SDKs (ollama-docs-9, ollama-docs-10, ollama-docs-11, ollama-gh-4), which is the core of an OpenAI-compatible local server story. However, the evidence pack never explicitly states 'OpenAI-compatible' endpoint support, and there's no confirmed OpenAPI spec (ollama-probe-3 shows 404s for openapi/swagger endpoints). Missing for 10: explicit documentation or hands-on confirmation of OpenAI-compatible endpoints (e.g., /v1/chat/completions), and independent verification of drop-in compatibility with OpenAI SDKs.

                                                                                                  • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                                                                                  • [claimed-docs] Use Ollama from Python.
                                                                                                  • [claimed-docs] Use Ollama from JavaScript or TypeScript.
                                                                                                  • [github] Ollama has a REST API for running and managing models.
                                                                                                  • [probe] PROBE openapi: all candidate paths 404 (https://ollama.com/openapi.json, https://ollama.com/swagger.json, https://ollama.com/api/openapi.jso…

                                                                                                  Jan's GitHub docs explicitly state it provides an OpenAI-compatible local API server at localhost:1337 for use with other applications, directly matching the story. Missing for 10: independent hands-on verification of the server (probes for openapi/llms.txt returned 404, and no third-party confirmation of usage exists in the pack).

                                                                                                  • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications

                                                                                                Deployment modes

                                                                                                1. developerRun the runtime headlessly with no GUI for use in servers or CI pipelines

                                                                                                  weight 2 · round to Ollama

                                                                                                  Evidence shows Ollama exposes a REST API and can be driven via curl, Python, and JS/TS (ollama-gh-4, ollama-docs-9/10/11), and community reports confirm it running as a background/server process on Linux and inside Docker/ROCm containers without any GUI (ollama-comm-16, ollama-comm-9, ollama-comm-13). However there is no explicit documentation of a dedicated 'serve' headless mode, CI-pipeline examples, or systemd/Docker deployment guide in the pack. missing for 10: explicit CI/pipeline docs, dedicated headless-serve documentation, first-party Docker/CI examples.

                                                                                                  • [github] Ollama has a REST API for running and managing models.
                                                                                                  • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                                                                                  • [claimed-docs] Use Ollama from Python.
                                                                                                  • [claimed-docs] Use Ollama from JavaScript or TypeScript.
                                                                                                  • [community] Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …
                                                                                                  • [community] It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks. They have shipped ROCm containers sinc…
                                                                                                  • [community] What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…
                                                                                                  Jannone0/10

                                                                                                  Jan is described as a desktop app with a GUI that exposes a local OpenAI-compatible API server (jan-gh-4), but there is no evidence of a headless mode, CLI-only server invocation, or CI/server deployment path without the GUI.

                                                                                                  • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                  • [github] This handles everything: installs dependencies, builds core components, and launches the app.

                                                                                                Generation controls

                                                                                                1. developerStream generated tokens back to my application as they are produced

                                                                                                  weight 3 · round to Jan
                                                                                                  Ollamanone0/10

                                                                                                  The evidence pack describes Ollama's REST API, curl usage, and Python/JS client libraries but never explicitly documents streaming token output as a capability; no mention of stream=true, chunked responses, or any developer discussion of receiving tokens incrementally. Missing for 10: explicit docs or examples showing streamed token responses, SDK streaming usage, or community confirmation of streaming behavior.

                                                                                                  • [claimed-docs] Learn the local and cloud base URLs, then send a request with curl.
                                                                                                  • [claimed-docs] Use Ollama from Python.
                                                                                                  • [claimed-docs] Use Ollama from JavaScript or TypeScript.
                                                                                                  • [github] Ollama has a REST API for running and managing models.

                                                                                                  Jan exposes an OpenAI-compatible local API server (localhost:1337), and OpenAI-compatible APIs conventionally support streaming, but the evidence pack never explicitly documents streaming token output as a feature; probes for API/OpenAPI specs also returned 404s, leaving this unconfirmed. Missing for 10: explicit documentation or hands-on confirmation of streaming responses, working API spec/reference showing stream parameter support.

                                                                                                  • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                  • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
                                                                                                2. developerConstrain model output to structured formats like JSON using grammars

                                                                                                  weight 2 · round drawn
                                                                                                  Ollamanone0/10

                                                                                                  The evidence pack contains no mention of structured output, JSON mode, grammars, or format constraints in Ollama's API despite this being a known capability of the real product; nothing here documents it.

                                                                                                    Jannone0/10

                                                                                                    No evidence pack item mentions grammars, JSON schema constraints, or structured output enforcement; only generic API/server and model integration features are documented. Missing for 10: any mention of grammar-based decoding, JSON mode, or structured output constraints in Jan's local server or API.

                                                                                                    • developerUse native tool-calling and reasoning-parser support in my requests

                                                                                                      weight 2 · round drawn
                                                                                                      Ollamanone0/10

                                                                                                      The evidence pack mentions Ollama's REST API and its use with coding agents like Claude Code, Codex, and Copilot, but nowhere explicitly documents native tool-calling support or a reasoning-parser feature in the API. Without direct evidence of these specific capabilities, the story cannot be credited as delivered.

                                                                                                      • [github] Ollama has a REST API for running and managing models.
                                                                                                      • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
                                                                                                      • [claimed-docs] Launch Claude Code, Codex, and more with one command.
                                                                                                      Jannone0/10

                                                                                                      Evidence shows Jan offers an OpenAI-compatible local API server and MCP integration for agentic capabilities, but there is no mention of native tool-calling support or reasoning-parser handling in requests; OpenAPI/spec probes also returned 404s, giving no documentation of these specific serving-API features.

                                                                                                      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                      • [github] Model Context Protocol: MCP integration for agentic capabilities
                                                                                                      • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…

                                                                                                    Model lifecycle

                                                                                                    1. developerAssign a custom identifier to a loaded model for consistent reference in API calls

                                                                                                      weight 1 · round drawn
                                                                                                      Ollamanone0/10

                                                                                                      The evidence pack covers model pulling, hotswapping, REST API existence, and cloud/local usage, but nothing describes assigning a custom identifier/alias to a loaded model (e.g., custom model naming via Modelfile or 'ollama cp') for consistent API reference. Missing for 10: any documentation or example of custom model naming/tagging and using that custom name in API calls.

                                                                                                      • [github] Ollama has a REST API for running and managing models.
                                                                                                      • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                      • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                      Jannone0/10

                                                                                                      Evidence shows Jan exposes an OpenAI-compatible local API server but contains no mention of assigning custom identifiers/aliases to loaded models for consistent API reference; probes for API docs even returned 404s.

                                                                                                      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                      • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…
                                                                                                    2. power-userLoad and switch between multiple models without restarting the server

                                                                                                      weight 2 · round to Ollama

                                                                                                      Community hands-on evidence directly confirms hotswapping models without server restarts, backed by simple pull/rm model management via REST API and CLI. missing for 10: first-party docs explicitly describing concurrent model loading/switching mechanics, and independent benchmarks on switch latency.

                                                                                                      • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                      • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                      • [github] Ollama has a REST API for running and managing models.

                                                                                                      Jan supports downloading/running multiple local models and exposes an OpenAI-compatible local server, implying model switching is plausible, but no evidence explicitly documents hot-swapping models without restarting the server. missing for 10: explicit docs/demo of switching loaded models via API without server restart, independent confirmation of this behavior.

                                                                                                      • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                      • [claimed-docs] Choose from open models or plug in your favorite online models.

                                                                                                    Remote serving

                                                                                                    1. power-userServe models over my local network for access from other devices

                                                                                                      weight 2 · round to Jan

                                                                                                      Ollama exposes a REST API for running/managing models (ollama-gh-4), which in principle could be reached from other devices, but the evidence pack has no explicit documentation of configuring Ollama to bind to a LAN interface (e.g. OLLAMA_HOST) and a community report explicitly notes the official app 'doesn't seem to offer any way to connect to a remote Ollama instance,' undercutting confidence that this is a smooth, first-class workflow. missing for 10: explicit docs on network/LAN binding configuration, first-party guidance for accessing the server from another device, and corroborating hands-on confirmation that remote access works well.

                                                                                                      • [github] Ollama has a REST API for running and managing models.
                                                                                                      • [community] I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own…

                                                                                                      Jan exposes an OpenAI-compatible local server at localhost:1337 for other applications to connect, which is the core capability needed for local-network serving, but there's no explicit documentation of binding to a network interface (0.0.0.0) or configuring access from other devices on the LAN. missing for 10: explicit network/LAN binding configuration docs, authentication/security guidance for exposing the server beyond localhost, independent confirmation of successful multi-device access.

                                                                                                      • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications

                                                                                                    Scale limits

                                                                                                    1. developerThe documented maximum concurrent requests or connections the local server can handle before throughput degrades

                                                                                                      weight 3 · round drawn
                                                                                                      Ollamanone0/10

                                                                                                      No documentation of a maximum concurrent request/connection limit or throughput degradation curve is present; evidence only vaguely references 'dedicated capacity' for cloud and REST API existence without concrete numbers or benchmarks tied to concurrency.

                                                                                                        Jannone0/10

                                                                                                        There is evidence Jan runs a local OpenAI-compatible server, but no documentation of maximum concurrent requests/connections or throughput degradation thresholds; probes for API/openapi docs returned 404s.

                                                                                                        • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                        • [probe] PROBE llms.txt: HTTP 404 at https://jan.ai/llms.txt
                                                                                                        • [probe] PROBE openapi: all candidate paths 404 (https://jan.ai/openapi.json, https://jan.ai/swagger.json, https://jan.ai/api/openapi.json, https://j…

                                                                                                      Server configuration

                                                                                                      1. power-userOverride low-level engine settings like memory locking or mmap behavior instead of being limited to opinionated defaults

                                                                                                        weight 2 · round drawn
                                                                                                        Ollamanone0/10

                                                                                                        No vendor documentation shows exposed low-level engine flags for mmap/mlock; explicit hands-on community feedback states Ollama actively hides such server configs (mlock) in favor of its own defaults, confirming the capability is absent.

                                                                                                        • [community] What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…
                                                                                                        Jannone0/10

                                                                                                        No evidence in the pack mentions exposing low-level engine settings like memory locking, mmap, or similar advanced runtime tuning options; only high-level features (model download, cloud integration, API server) are documented.

                                                                                                        Ux tooling — the working surface itself — layout, ergonomics, quality-of-life toolingUx tooling

                                                                                                        The working surface itself — layout, ergonomics, quality-of-life tooling

                                                                                                        Ai assisted setup

                                                                                                        1. ai-native userRely on an AI assistant to recommend which local model best fits my hardware and task before I download it

                                                                                                          weight 2 · round drawn
                                                                                                          Ollamanone0/10

                                                                                                          No evidence of any AI assistant or recommendation feature that suggests which local model fits a user's hardware/task before download; the evidence covers model pulling, switching, running, and API/CLI usage but nothing about hardware-aware model recommendations.

                                                                                                            Jannone0/10

                                                                                                            Evidence shows Jan lets users browse/download models from HuggingFace and choose between local or cloud models, but there is no mention of any AI assistant or recommendation engine that suggests which model fits a user's hardware or task before downloading. missing for 10: hardware-detection/benchmarking feature, model-recommendation UI or assistant, any first-party or community mention of such a guidance feature.

                                                                                                            • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                            • [claimed-docs] Choose from open models or plug in your favorite online models.

                                                                                                          Chat interface

                                                                                                          1. power-userChat with local models using a built-in graphical chat interface

                                                                                                            weight 3 · round to Jan

                                                                                                            Community evidence confirms Ollama shipped a native desktop GUI app (macOS/Windows) that lets users chat with local models, with multimodal and Markdown support working as expected (ollama-comm-16, ollama-comm-18). However, the same evidence shows real caveats: no Linux support, no way to connect to a remote Ollama instance, and some developer pushback that building a GUI is outside Ollama's core mission (ollama-comm-17, ollama-comm-19, ollama-comm-20). Missing for 10: official first-party docs describing the GUI's features, cross-platform (Linux) parity, and independent hands-on reviews beyond a single HN thread.

                                                                                                            • [community] Ollama's new app is now available for macOS and Windows... linux sounds out for now. No Linux, that's a bummer. I've been using it in Linux …
                                                                                                            • [community] I am somewhat surprised that this app doesn't seem to offer any way to connect to a remote Ollama instance. The most powerful computer I own…
                                                                                                            • [community] I like the simplicity. This would be perfect for setting up a non-technical friend or family member with a local LLM with just a couple clic…
                                                                                                            • [community] completely useless move. there are already tons of good clients for Ollama. The Ollama devs need to focus on being a better llama.cpp, not b…
                                                                                                            • [community] Well, they gotta do what they gotta do. But as a developer, this kills the positioning and trust it had for me. I do not see it as a develop…

                                                                                                            Jan is a desktop app with a built-in GUI for downloading and chatting with local LLMs, corroborated by community mention of using Jan.ai as a chat client alongside OpenWebUI. missing for 10: detailed hands-on screenshots/reviews of the chat UI itself and independent power-user critique of the interface's depth/features.

                                                                                                            • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                            • [github] Download and run LLMs with **full control** and **privacy**.
                                                                                                            • [claimed-docs] Choose from open models or plug in your favorite online models.
                                                                                                            • [claimed-docs] Personal Intelligence that answers only to you
                                                                                                            • [community] I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.

                                                                                                          Cli tooling

                                                                                                          1. developerStart an interactive chat session with a model directly from the terminal

                                                                                                            weight 2 · round to Ollama

                                                                                                            GitHub docs explicitly show 'ollama run' used to chat with a model (e.g. 'Run and chat with Gemma 4'), and community benchmarks confirm real-world use of 'ollama run <model> --verbose' for interactive terminal sessions, corroborating the core CLI chat workflow. Missing for 10: a dedicated first-party tutorial on the interactive REPL commands (e.g. /bye, /set) and independent UX review specifically of the chat session experience.

                                                                                                            • [github] Run and chat with [Gemma 4](https://ollama.com/library/gemma4):
                                                                                                            • [community] User benchmark on M4 Pro 48GB: qwen3.5:35b-a3b-q4_K_M eval rate 30.0, nvfp4 66.5, int4 84.4 tokens/sec via 'ollama run' with --verbose.
                                                                                                            • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                            • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                            Jannone0/10

                                                                                                            The evidence describes Jan as a desktop GUI app with a local OpenAI-compatible server and MCP integration, but there is no mention of a CLI or terminal-based interactive chat mode. missing for 10: any documentation of a CLI chat command, terminal REPL, or command-line interface for starting a chat session.

                                                                                                            • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                            • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                            • [github] This handles everything: installs dependencies, builds core components, and launches the app.
                                                                                                          2. developerSearch, download, and manage models from a command-line interface

                                                                                                            weight 2 · round to Ollama

                                                                                                            Community evidence strongly confirms CLI-based model search/pull/remove/hotswap workflows (ollama pull, ollama rm, model registry browsing) as core, well-liked functionality, corroborated by multiple independent hands-on accounts. Missing for 10: first-party CLI reference docs in the evidence pack detailing search/list commands, and independent benchmarking of management UX beyond community anecdotes.

                                                                                                            • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                            • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                            • [community] No mention of the fact that Ollama is about 1000x easier to use. Llama.cpp is a great project but one of the least user friendly pieces of s…
                                                                                                            • [github] Run and chat with [Gemma 4](https://ollama.com/library/gemma4):
                                                                                                            • [github] Ollama has a REST API for running and managing models.
                                                                                                            • [community] Ollama is definitely the easiest way to run LLMs locally... It's like how Docker made it so any application can execute something portably o…
                                                                                                            Jannone0/10

                                                                                                            Jan is presented as a desktop GUI app with model download/run features and a local API server, but no evidence describes a CLI for searching, downloading, or managing models — the build script (jan-gh-7) is a dev setup tool, not a model-management CLI.

                                                                                                            • developerLoad a model with custom GPU offload and context length settings from the command line

                                                                                                              weight 1 · round drawn
                                                                                                              Ollamanone0/10

                                                                                                              No evidence in the pack shows Ollama CLI flags for setting GPU offload or context length; the only related community evidence (ollama-comm-13) explicitly complains that Ollama 'hides all the server configs in favor of their own sane defaults' and doesn't expose things like mlock, suggesting limited low-level CLI tuning rather than confirming it.

                                                                                                              • [community] What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…
                                                                                                              Jannone0/10

                                                                                                              No evidence in the pack mentions a CLI for Jan, let alone CLI flags for GPU offload or context length; evidence only covers GUI-based model download, cloud integration, and local API server. Missing for 10: any mention of a command-line interface, CLI flags for GPU layers/offload, or context-length parameters.

                                                                                                              • developerStart and stop the local model server from the command line

                                                                                                                weight 1 · round to Ollama

                                                                                                                Evidence shows Ollama runs as a background server process managed via CLI commands (e.g., 'ollama run', 'ollama pull') and a REST API for managing models, with community mentions of not needing to restart the server, but there is no explicit documentation of a dedicated 'ollama serve' start command or an explicit stop/shutdown CLI command. missing for 10: explicit docs for 'ollama serve' start command, explicit CLI stop/kill command, and confirmation these work cross-platform.

                                                                                                                • [github] Ollama has a REST API for running and managing models.
                                                                                                                • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                                • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                                Jannone0/10

                                                                                                                Evidence confirms Jan runs a local OpenAI-compatible API server at localhost:1337, but there is no mention of a CLI command or terminal interface to start/stop that server — the app appears GUI-driven, with build scripts (jan-gh-7) referring to app launch, not a dedicated server CLI. missing for 10: documented CLI commands (e.g. jan serve/jan stop) or terminal-based start/stop control of the local model server.

                                                                                                                • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                                • [github] This handles everything: installs dependencies, builds core components, and launches the app.
                                                                                                              • developerLaunch popular third-party coding agent CLIs pre-configured to use my local models with a single command

                                                                                                                weight 2 · round to Ollama
                                                                                                                Ollamafullclaimed7/10

                                                                                                                Ollama's own docs explicitly state you can 'Launch Claude Code, Codex, and more with one command' pre-configured to use local models, and GitHub docs list direct integration with Claude Code, Codex, Copilot, OpenCode, etc. This directly matches the story, though it rests solely on vendor claims without independent hands-on confirmation of the single-command launch experience. Missing for 10: independent/community verification of the one-command launch flow, and details on how pre-configuration (model selection, API keys) is handled.

                                                                                                                • [claimed-docs] Launch Claude Code, Codex, and more with one command.
                                                                                                                • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
                                                                                                                • [claimed-docs] Ollama lets you use open models with your coding agents so you can spend less while keeping your data private.
                                                                                                                Jannone0/10

                                                                                                                No evidence Jan provides a one-command launcher for third-party coding agent CLIs (e.g., Claude Code, Aider) pre-configured to local models; it only offers a local OpenAI-compatible API server and MCP integration, which developers would need to manually configure themselves.

                                                                                                                • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                                • [github] Model Context Protocol: MCP integration for agentic capabilities

                                                                                                              Document intelligence

                                                                                                              1. ai-native userChat with my own documents entirely offline using automatic retrieval-augmented generation

                                                                                                                weight 2 · round drawn
                                                                                                                Ollamanone0/10

                                                                                                                Ollama provides local model serving and APIs but the evidence shows no built-in RAG/document-chat feature, embeddings pipeline, or automatic retrieval system for chatting with documents; it only supports running models and connecting external agents/tools.

                                                                                                                  Jannone0/10

                                                                                                                  No evidence pack item mentions document upload, retrieval-augmented generation, or automatic RAG over personal documents; features listed are local LLMs, cloud integration, custom assistants, API server, and MCP, none of which describe document chat/RAG.

                                                                                                                  Local model management

                                                                                                                  1. power-userManage my downloaded models, saved prompts, and per-model configurations in one place

                                                                                                                    weight 2 · round to Jan

                                                                                                                    Evidence shows straightforward model download/removal/hotswap management (ollama pull/rm) as a core CLI workflow, but there is no evidence of a 'saved prompts' feature or a unified place to manage prompts alongside models, and one community report explicitly says Ollama hides server/per-model configuration options behind fixed defaults rather than exposing them for management. missing for 10: saved-prompt management, a unified UI/CLI view combining models+prompts+configs, and evidence of exposed per-model configuration controls.

                                                                                                                    • [community] The biggest advantage for me with ollama is the ability to 'hotswap' models with different utility instead of restarting the server, combine…
                                                                                                                    • [community] I prefer Ollama over the suggested alternatives. A new model on HF or Ollama registry? One 'ollama pull' and it's available. Underwhelming? …
                                                                                                                    • [community] What I hate about ollama is that it makes server configuration a PITA. ollama relies on llama.cpp which can keep the model in memory using m…

                                                                                                                    Jan supports downloading/running local models and custom assistants, implying some per-model management, but there's no concrete evidence of a unified UI for managing saved prompts or per-model configuration settings in one place. Missing for 10: dedicated prompt-library management, explicit per-model config UI, and independent hands-on confirmation of a unified management view.

                                                                                                                    • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                                    • [github] Custom Assistants: Create specialized AI assistants for your tasks
                                                                                                                    • [claimed-docs] Choose from open models or plug in your favorite online models.

                                                                                                                  Not comparable on these axes

                                                                                                                  1. ai-native userConnect an agent via an official MCP server

                                                                                                                    weight 3 · not comparable
                                                                                                                    Ollamanone0/10

                                                                                                                    Evidence shows Ollama integrates with coding agents (Claude Code, Codex, etc.) as a backend model provider via REST API, but there is no mention of Ollama shipping an official MCP server that agents could connect to.

                                                                                                                    • [github] connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more.
                                                                                                                    • [github] Ollama has a REST API for running and managing models.
                                                                                                                    • [claimed-docs] Launch Claude Code, Codex, and more with one command.
                                                                                                                    Jann/a

                                                                                                                    Jan is itself an AI assistant/agent application (local chat app with model integration), and the MCP evidence (jan-gh-5) describes Jan connecting to MCP servers as a client for agentic capabilities, not Jan exposing itself as an MCP server for other agents to connect to. Per the agent-role rule, serving as an MCP server is a different product role from being an agent, and no evidence shows Jan running an MCP server endpoint (only an OpenAI-compatible API server is documented in jan-gh-4).

                                                                                                                    • [github] Model Context Protocol: MCP integration for agentic capabilities
                                                                                                                    • [github] OpenAI-Compatible API: Local server at `localhost:1337` for other applications
                                                                                                                  2. ai-native userGet AI-generated insights and suggestions from my data inside the product

                                                                                                                    weight 2 · not comparable
                                                                                                                    Ollaman/a

                                                                                                                    Ollama is a local/cloud model-serving runtime and API, not a data application that surfaces AI-generated insights from a user's own data; there is no product surface (dashboards, documents, analytics) into which insights would be embedded. This story applies to data-centric products, not to a model-runner tool like Ollama.

                                                                                                                      Jannone0/10

                                                                                                                      Evidence shows Jan supports local/cloud LLM chat, custom assistants, and MCP integration, but nothing describes analyzing or surfacing insights from the user's own data inside the product (no RAG, document analysis, or data-insight feature mentioned).

                                                                                                                      • [github] Local AI Models: Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace
                                                                                                                      • [github] Cloud Integration: Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, MiniMax, and others
                                                                                                                      • [github] Custom Assistants: Create specialized AI assistants for your tasks
                                                                                                                      • [github] Model Context Protocol: MCP integration for agentic capabilities
                                                                                                                      • [claimed-docs] Choose from open models or plug in your favorite online models.
                                                                                                                    • ai-native userSet up automations that run autonomously in the background

                                                                                                                      weight 2 · not comparable
                                                                                                                      Ollaman/a

                                                                                                                      Ollama is a local/cloud model-serving runtime with an API, not an automation/orchestration platform; setting up autonomous background automations is outside its product category (though it can be integrated into agents built by others).

                                                                                                                        Jannone0/10

                                                                                                                        Evidence shows Jan supports local/cloud LLMs, custom assistants, an OpenAI-compatible API, and MCP integration for agentic capabilities, but nothing describes scheduling, triggers, or background-running automations that operate autonomously without user interaction.

                                                                                                                        • ai-native userTest against a sandbox environment without touching production data

                                                                                                                          weight 1 · not comparable
                                                                                                                          Ollaman/a

                                                                                                                          Ollama is a local/cloud LLM runtime, not a data platform or SaaS with production data and a sandbox/staging environment concept; the 'sandbox vs production data' framing is a category error for this product type.

                                                                                                                            Jann/a

                                                                                                                            Jan is a local desktop AI assistant/model runner, not a service with production data or sandbox/staging environments to test against — this axis doesn't apply to its category.

                                                                                                                            • ai-native userDefine rules that trigger actions automatically on events

                                                                                                                              weight 3 · not comparable
                                                                                                                              Ollaman/a

                                                                                                                              Ollama is a local/cloud model runtime and API server, not a workflow/automation platform; defining event-triggered rules is outside its product category (wrong axis).

                                                                                                                                Jannone0/10

                                                                                                                                No evidence Jan supports defining rules/triggers that automatically fire actions on events; evidence covers local models, cloud integration, assistants, API server, and MCP integration but nothing about event-driven automation or rule engines.

                                                                                                                                • ai-native userSchedule recurring jobs or workflows

                                                                                                                                  weight 2 · not comparable
                                                                                                                                  Ollaman/a

                                                                                                                                  Ollama is a local/cloud model runtime and API server, not a workflow/job orchestration platform; scheduling recurring jobs is outside its product category and would be handled by external tooling (cron, agents) rather than Ollama itself.

                                                                                                                                    Jannone0/10

                                                                                                                                    No evidence of scheduling, cron-like recurring jobs, or workflow automation features; Jan is presented as a local LLM chat/assistant app with MCP and API server capabilities but nothing about recurring/scheduled task execution.

                                                                                                                                    • ai-native userVersion, review, and roll back my automations

                                                                                                                                      weight 1 · not comparable
                                                                                                                                      Ollaman/a

                                                                                                                                      Ollama is a local/cloud model runtime and API, not an automation/workflow-builder product; versioning, reviewing, and rolling back 'automations' is not an applicable concept for this product category.

                                                                                                                                        Jannone0/10

                                                                                                                                        No evidence of versioning, review, or rollback capabilities for automations/assistants; Jan's evidence covers model running, cloud integration, custom assistants, and MCP, but nothing about tracking changes or reverting them.

                                                                                                                                        • developerDisaggregate prefill and decode phases for optimized large-scale serving

                                                                                                                                          weight 1 · not comparable
                                                                                                                                          Ollaman/a

                                                                                                                                          Prefill/decode disaggregation is a large-scale distributed serving optimization (multi-node inference infrastructure) that is entirely outside Ollama's product category as a single-node local/cloud model runner; nothing in the evidence pack even gestures at distributed serving architecture, so this is a category error rather than a missing feature.

                                                                                                                                            Jann/a

                                                                                                                                            Jan is a local desktop app for running LLMs on personal hardware, not a large-scale distributed serving system; prefill/decode disaggregation is an infrastructure-scale optimization for datacenter inference serving, which is a category error for this product type.

                                                                                                                                            • ai-native userHave an AI agent draft and edit documents in an integrated workspace with changes saved automatically

                                                                                                                                              weight 1 · not comparable
                                                                                                                                              Ollaman/a

                                                                                                                                              Ollama is a local/cloud model runtime and API layer, not a document-editing workspace product; it provides no integrated workspace with autosave for AI-drafted documents. This story is a category error for this product type.

                                                                                                                                                Jannone0/10

                                                                                                                                                Jan is a chat/LLM runner with assistants, MCP, and API access, but there is no evidence of an integrated document workspace where an AI agent drafts/edits documents with autosave.

                                                                                                                                                • ai-native userDictate speech that gets transcribed in real time by an on-device model

                                                                                                                                                  weight 1 · not comparable
                                                                                                                                                  Ollaman/a

                                                                                                                                                  Ollama is a local LLM runtime/serving tool for text (and some multimodal) models; there is no evidence of speech-to-text/dictation or real-time transcription capability, and this is not the product's category — voice dictation is a distinct axis unrelated to running LLMs locally.

                                                                                                                                                    Jannone0/10

                                                                                                                                                    No evidence in the pack mentions speech dictation, voice input, or real-time transcription capability in Jan; all evidence covers text-based LLM chat, cloud/local model integration, and APIs.