Skip to content

Groq vs Morph

free-tier · usage-based · enterprise-custom

·

usage-based · enterprise-custom

Groq wins · 199 (16 drawn)

Agenticness — how well agents can access and operate the productAgenticness

How well agents can access and operate the product

Agent access

  1. ai-native userPoint an agent at llms.txt or agent-oriented docs

    weight 2 · round drawn

    Direct probe evidence confirms llms.txt is live (HTTP 200) at console.groq.com/llms.txt, and Groq also serves per-page .md docs (docs/overview.md) explicitly designed for agent consumption, indicating agent-oriented docs beyond just llms.txt. Missing for 10: no independent/community confirmation of an agent actually using llms.txt in practice.

    • [probe] PROBE llms.txt: HTTP 200 at https://console.groq.com/llms.txt # https://console.groq.com llms.txt - [JigsawStack 🧩](https://console.groq.c…
    • [probe] PROBE docs-md: HTTP 200 at https://console.groq.com/docs/overview.md --- description: Fast LLM inference, OpenAI-compatible. Simple to integ…
    Morphfullprobed9/10

    Morph confirms llms.txt is live and documented (HTTP 200) with a full documentation index, and also exposes .md versions of docs pages explicitly for agent consumption, directly matching the story's ask. Missing for 10: no independent/community confirmation of agents actually consuming llms.txt in practice.

    • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
    • [probe] PROBE docs-md: HTTP 200 at https://docs.morphllm.com/introduction.md > ## Documentation Index > Fetch the complete documentation index at: h…
    • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
  2. ai-native userRun the product headlessly / in CI for automation

    weight 2 · round to Groq

    Groq is a pure API/inference service accessed via OpenAI-compatible REST endpoints and SDKs (API key + base_url swap), with batch processing for large-scale asynchronous automation and confirmed live, key-gated JSON endpoints — all of which are inherently scriptable/headless with no GUI dependency, ideal for CI pipelines. Missing for 10: explicit CI/CD examples (e.g., GitHub Actions) or docs specifically framing headless/automation use cases beyond batch API references.

    • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
    • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
    • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
    • [github] Request parameters that correspond to file uploads can be passed in many different forms
    • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …
    • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas

    Morph is delivered as an OpenAI/Anthropic-compatible HTTP API (morph-docs-1, morph-docs-16) plus a batch mode explicitly designed for running 'thousands of chat completions offline' (morph-docs-13), both of which are naturally scriptable/headless and usable from CI pipelines. However, there is no explicit CI/CD documentation, GitHub Actions example, or automation-pipeline guide in the evidence pack. Missing for 10: explicit CI/automation guide or example, dedicated headless-mode docs beyond generic API access, independent confirmation of CI usage.

    • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
    • [claimed-docs] Run thousands of chat completions offline at half price.
    • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
    • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
  3. ai-native userConnect an agent via an official MCP server

    weight 3 · round to Morph

    There is a probe hit indicating an official MCP-server doc page exists (console.groq.com/docs/mcp), but the evidence pack contains no actual content, setup instructions, or independent confirmation of this server — the detailed MCP docs quoted (groq-docs-6/17/28) describe Groq's API acting as an MCP *client* consuming remote MCP servers, not Groq serving as an MCP server for other agents to connect to. Missing for 10: quoted documentation of the official MCP server's endpoint/connection instructions, evidence of an agent successfully connecting to Groq via that server, and independent/community confirmation it works as advertised.

    • [probe] official MCP server documented at https://console.groq.com/docs/mcp
    • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
    • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
    Morphfullprobed7/10

    Morph publishes an official MCP server (guides/mcp.md, quickstart 'Install the Morph MCP so Claude Code can read it') that lets external agents like Claude Code connect to its fast file-editing/search tools, confirmed live via probe [morph-probe-4]. missing for 10: independent/hands-on confirmation that the MCP server works as documented (community evidence only covers the apply model, not MCP connectivity), and no detail on MCP tool list/config beyond the guide.

    • [claimed-docs] Connect your favorite AI tools to Morph's blazing-fast file editing via Model Context Protocol.
    • [claimed-docs] Install the Morph MCP so Claude Code can read it
    • [claimed-docs] Use Morph's Warp-Grep for fast, local code search alongside your MCP setup.
    • [probe] official MCP server documented at https://docs.morphllm.com/guides/mcp
  4. ai-native userUse an official CLI

    weight 2 · round drawn
    Groqnone0/10

    No evidence of an official Groq CLI tool; documentation covers SDKs (Python/TypeScript), REST API, and MCP integration but no CLI is mentioned anywhere in the evidence pack.

      Morphnone0/10

      Morph is API/SDK-focused (OpenAI-compatible endpoints, MCP integration, Fast Apply, etc.) but no evidence pack item mentions an official Morph CLI tool; community only references third-party CLIs (llm.datasette.io) connecting to Morph's API, not a first-party CLI shipped by Morph.

      • ai-native userDrive the product through a documented public API

        weight 3 · round to Groq

        Groq ships an extensively documented, OpenAI-compatible REST API (chat completions, streaming, tool use, structured outputs, batch, service tiers, LoRA, Responses API) with a live confirmed endpoint (401 on missing key, not 404) and a public status page. Missing for 10: a discoverable formal OpenAPI/Swagger spec (all candidate paths 404).

        • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
        • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
        • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
        • [claimed-docs] Generating text with Groq's Chat Completions API enables you to have natural, conversational interactions with Groq's large language models.
        • [claimed-docs] To use tools, the model must be provided with tool definitions. These tool definitions are in JSON schema format and are passed to the model…
        • [claimed-docs] Structured Outputs is a feature that ensures your model responses conform to your provided JSON Schema
        • [claimed-docs] Groq's Responses API is fully compatible with OpenAI's Responses API, making it easy to integrate advanced conversational AI capabilities in…
        • [probe] PROBE llms.txt: HTTP 200 at https://console.groq.com/llms.txt # https://console.groq.com llms.txt - [JigsawStack 🧩](https://console.groq.c…
        • [probe] PROBE docs-md: HTTP 200 at https://console.groq.com/docs/overview.md --- description: Fast LLM inference, OpenAI-compatible. Simple to integ…
        • [probe] PROBE openapi: all candidate paths 404 (https://console.groq.com/openapi.json, https://console.groq.com/swagger.json, https://console.groq.c…
        • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …
        • [probe] PROBE status-page (2026-09-04): https://groqstatus.com returns HTTP 200 and renders a public service-status page (page body includes "operat…
        Morphfullprobed8/10

        Morph documents a public OpenAI-compatible API at api.morphllm.com/v1 plus a native Anthropic Messages endpoint, with SDK docs covering chat, Fast Apply, Compact, Batch, caching, and dedicated endpoints, and this is corroborated by third-party usage (HN commenters, github demos) actually driving it programmatically. Missing for 10: no discoverable OpenAPI/swagger spec (404s on all probed paths) and mixed community reports on output reliability reduce polish.

        • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
        • [claimed-docs] Fast Apply merges just the changed lines at 10,500 tok/s, 98% accuracy.
        • [claimed-docs] Drop filler from chat history and code context at 33,000 tok/s. 50-70% reduction, every surviving line byte-for-byte identical to input.
        • [claimed-docs] Run thousands of chat completions offline at half price.
        • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
        • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
        • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
        • [github] Use Morph's API to intelligently modify existing code at 4,500+ tokens/sec
        • [community] Have been using morph for a while (I am one of the authors of goose) and was surprised when introduced at the boost it gave me (much less it…
        • [community] This uses an OpenAI-compatible endpoint, so got this working with my llm.datasette.io CLI tool... One thing that worries me: since it's usin…
      • ai-native userIssue scoped/least-privilege API credentials for an agent

        weight 2 · round drawn
        Groqnone0/10

        Evidence covers billing spend limits and general API key auth (single api_key parameter) but shows no support for scoped/least-privilege credentials such as role-based keys, granular permission scopes, or per-agent restricted tokens; only one flat API key model is documented.

        • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
        • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
        • [claimed-docs] Spend Limits: Set automated spending limits and receive budget alerts
        • [claimed-docs] Spend Limits:** Set automated spending limits and receive budget alerts
        Morphnone0/10

        Evidence shows only a single API key covering all models/tools with no mention of scoped, least-privilege, or role-based credential issuance for agents; no docs on permission scoping, sub-keys, or credential restriction. missing for 10: scoped/limited-permission API key creation, per-agent credential issuance, role-based access control docs.

        • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
      • ai-native userBuild against official SDKs

        weight 2 · round to Groq

        Groq maintains an official TypeScript SDK (groq-typescript) with concrete usage examples (audio transcription, file uploads) and extensive first-party docs covering chat completions, streaming, tool use, structured outputs, and OpenAI-compatible client usage, all of which are core to building against official SDKs. Missing for 10: explicit evidence of an official Python SDK repo (only OpenAI-compatible base_url swap is shown for Python) and independent/community validation specifically of SDK reliability rather than general API performance.

        • [github] Request parameters that correspond to file uploads can be passed in many different forms
        • [github] await client.audio.transcriptions.create({ model: 'whisper-large-v3-turbo', file: fs.createReadStream('/path/to/file'), });
        • [github] If you have access to Node fs we recommend using fs.createReadStream()... Or if you have the web File API you can pass a File instance
        • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
        • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
        • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas
        • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
        • [claimed-docs] Structured Outputs is a feature that ensures your model responses conform to your provided JSON Schema

        Morph documents OpenAI-SDK and Anthropic Messages-API compatibility (point any OpenAI SDK at api.morphllm.com, native /v1/messages support), and community evidence confirms real developers wiring it up via OpenAI-compatible clients (e.g. llm.datasette.io CLI). However there's no evidence of a first-party Morph-branded SDK package, and an OpenAPI spec probe returned 404s across all candidate paths, suggesting no formal machine-readable API spec is published. missing for 10: dedicated first-party Morph SDK package, discoverable OpenAPI/swagger spec, broader language-SDK coverage beyond OpenAI/Anthropic compatibility.

        • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
        • [claimed-docs] Claude Code speaks the Anthropic Messages API, which Morph serves natively at `/v1/messages`.
        • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
        • [community] This uses an OpenAI-compatible endpoint, so got this working with my llm.datasette.io CLI tool... One thing that worries me: since it's usin…
        • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
      • ai-native userSubscribe to events via webhooks

        weight 2 · round drawn
        Groqnone0/10

        No evidence anywhere in the pack of a webhooks/event-subscription feature for Groq's API—only synchronous/streaming inference, batch, tool-use/MCP, and admin/billing docs are covered.

          Morphnone0/10

          No evidence in the pack mentions webhooks or any event-subscription mechanism; Morph's documented surface is API endpoints, MCP integration, and model tooling, with no webhook capability described.

          Agentic features

          1. ai-native userSet up automations that run autonomously in the background

            weight 2 · round drawn
            Groqnone0/10

            Groq's evidence covers only inference primitives (chat completions, tool use, MCP tool integration, batch processing, structured outputs) — none of which describe a scheduling/trigger system for autonomous background automations; batch jobs are asynchronous request batches, not persistent background agents. Missing for 10: any documented scheduler, cron/trigger mechanism, persistent background agent runtime, or workflow orchestration feature that lets a user 'set up' an automation to run unattended.

            • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
            • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
            • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
            Morphnone0/10

            Morph is presented as an LLM inference/API platform (fast apply, compact, batch completions, canary/reflex model switching) rather than a background automation or agent-orchestration product; nothing in the evidence describes setting up autonomous, self-running background automations or scheduled agentic tasks. The closest features (batch processing, canary traffic routing) are developer-triggered infra operations, not autonomous background automations.

            • [claimed-docs] Run thousands of chat completions offline at half price.
            • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
            • [claimed-docs] A canary keeps your current provider, sends a slice of production traffic to Kimi K3, and compares Reflex results before you switch.

          Api quality

          1. ai-native userExplore an interactive API reference with runnable examples

            weight 2 · round to Groq

            Groq's docs (console.groq.com/docs) are extensive and code-example-rich (curl/Python/JS snippets for chat, tool-use, structured outputs, batch, MCP, etc.), functioning as a de facto API reference, but there's no evidence of an interactive, in-browser 'runnable' playground or embedded code execution — probes show no discoverable OpenAPI/swagger spec (404s) and no mention of a try-it-now console feature. Missing for 10: an actual interactive/executable API reference (e.g., Swagger UI, embedded runnable code sandbox), confirmation of an OpenAPI spec, and independent user confirmation of using such an interactive reference.

            • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
            • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
            • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas
            • [probe] PROBE docs-md: HTTP 200 at https://console.groq.com/docs/overview.md --- description: Fast LLM inference, OpenAI-compatible. Simple to integ…
            • [probe] PROBE openapi: all candidate paths 404 (https://console.groq.com/openapi.json, https://console.groq.com/swagger.json, https://console.groq.c…
            Morphnone0/10

            The evidence shows standard markdown docs (llms.txt, introduction.md) but no interactive API reference or runnable-example explorer — probes for an OpenAPI/Swagger spec returned 404 on every candidate path, and no docs mention a live API console. A community mention of a separate 'playground' relates to testing the apply model, not an API reference tool, and doesn't establish this capability.

            • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
            • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
            • [probe] PROBE docs-md: HTTP 200 at https://docs.morphllm.com/introduction.md > ## Documentation Index > Fetch the complete documentation index at: h…
          2. ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

            weight 2 · round drawn
            Groqnone0/10

            Groq's API is OpenAI-compatible and well documented, but there is no evidence of a downloadable OpenAPI/Swagger spec; a direct probe of common spec paths (openapi.json, swagger.json, etc.) all returned 404, and no docs page links to a machine-readable spec.

            • [probe] PROBE openapi: all candidate paths 404 (https://console.groq.com/openapi.json, https://console.groq.com/swagger.json, https://console.groq.c…
            Morphnone0/10

            Morph is API-based (OpenAI-compatible endpoint), so an OpenAPI spec is a fair expectation, but a direct probe found all candidate OpenAPI/swagger spec paths returned 404, and no evidence pack item shows a downloadable machine-readable spec.

            • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
          3. ai-native userRely on versioned APIs with a documented deprecation policy

            weight 2 · round drawn
            Groqnone0/10

            No evidence pack item documents API versioning conventions or a formal deprecation policy for Groq's endpoints or models; docs cover OpenAI-compatibility, features, and pricing but not lifecycle/versioning guarantees.

              Morphnone0/10

              No evidence of API versioning scheme (e.g., v1/v2) or a documented deprecation policy anywhere in the docs; the /v1 path is just the base URL, not a versioning/deprecation commitment. OpenAPI spec probes also 404, further indicating no formal versioned API contract is published.

              • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
              • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools

            Automation depth — how much of the product can run unattendedAutomation depth

            How much of the product can run unattended

            1. ai-native userPerform bulk operations across many items at once

              weight 2 · round to Groq

              Groq's Batch API explicitly supports submitting thousands of API requests asynchronously at 50% lower cost with a 24h-7day processing window, directly satisfying bulk operations across many items, and higher-throughput Flex processing further supports large-scale workloads. Missing for 10: independent hands-on verification of batch job completion/reliability at scale and details on per-batch item limits or error handling.

              • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
              • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
              • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing.
              • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing. Pricing mat…

              Morph offers batch offline completions (morph-docs-13) and fast bulk file-editing/apply capabilities (morph-docs-11, morph-gh-1), which support some bulk/automation-depth use cases, but there is no documented feature for bulk operations across many arbitrary items (e.g., batch file renames, mass repo-wide refactors, multi-item dataset operations) beyond chat completions and code apply. missing for 10: explicit bulk/batch operation APIs beyond chat completions, evidence of bulk operations across many discrete items (files, records, tickets) rather than just token throughput, independent verification of bulk reliability at scale.

              • [claimed-docs] Run thousands of chat completions offline at half price.
              • [claimed-docs] Fast Apply merges just the changed lines at 10,500 tok/s, 98% accuracy.
              • [github] Use Morph's API to intelligently modify existing code at 4,500+ tokens/sec

            Batch async — stories about batch async in this arenaBatch async

            Stories about batch async in this arena

            Batch

            1. ml-engineerSubmit asynchronous batch inference jobs at a documented discount versus real-time pricing

              weight 2 · round to Groq

              Groq's official docs explicitly describe an asynchronous batch API delivering 50% lower cost than standard on-demand pricing, with a 24-hour to 7-day processing window and no impact on standard rate limits (groq-docs-7, groq-docs-29). This directly matches the story's requirement of documented discounted async batch inference. Missing for 10: independent/hands-on confirmation of the batch discount actually being applied in practice, and more detail on job submission/monitoring workflow beyond the docs summary.

              • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
              • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…

              Morph documents a batch component explicitly for offline, asynchronous chat completions at 'half price' (morph-docs-13), directly matching the story's async-job-with-discount claim. However, there's no detail on job submission/status API mechanics, SLA/turnaround time, or independent confirmation of the discount in practice. missing for 10: detailed batch API docs (submission, polling, output retrieval), documented turnaround SLAs, independent/community verification of discount pricing.

              • [claimed-docs] Run thousands of chat completions offline at half price.

            Dedicated capacity — stories about dedicated capacity in this arenaDedicated capacity

            Stories about dedicated capacity in this arena

            Dedicated

            1. ml-engineerDeploy a model on dedicated GPU capacity with autoscaling so my traffic is isolated from the shared serverless pool

              weight 2 · round to Morph
              Groqnone0/10

              Evidence shows Groq's service tiers (on-demand, flex, auto) and batch processing, all within the shared serverless API, but no documentation of dedicated GPU capacity or customer-isolated infrastructure with autoscaling; one community remark about 'call us for quotes' for newer models hints at an enterprise track but gives no detail on dedicated capacity or autoscaling.

              • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability.
              • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing.
              • [claimed-docs] auto: Pass this if you dont want to think about tiers and you want to leverage the best tier available to you at any given moment.
              • [community] As soon as i saw they switched to 'call us for quotes' for the new models, i knew they are over.

              Morph docs mention 'dedicated endpoints' where you reserve model capacity and plan and Morph provisions/operates it, which implies isolated capacity, but there is no mention of autoscaling, traffic isolation guarantees, or GPU-level specifics. missing for 10: explicit autoscaling behavior, confirmation of traffic isolation from shared serverless pool, GPU capacity details, independent corroboration of dedicated endpoint performance.

              • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it

            Fine tune serving — stories about fine tune serving in this arenaFine tune serving

            Stories about fine tune serving in this arena

            Fine tune

            1. ml-engineerFine-tune a supported base model on my own data and serve the result on the same platform

              weight 2 · round to Morph
              Groqnone0/10

              Groq's docs show it supports serving pre-made LoRA adapters for inference (groq-docs-11, groq-docs-20, groq-docs-32), but there is no evidence of any fine-tuning/training capability on the platform itself — adapters must be trained elsewhere and uploaded. No mention of a fine-tuning API, training jobs, or dataset ingestion for model customization.

              • [claimed-docs] Upload your existing LoRA adapters to run specialized inference while maintaining the performance and efficiency of Groq's infrastructure.
              • [claimed-docs] With LoRA inference on Groq, you can: Run inference with your pre-made LoRA adapters
              • [claimed-docs] Groq provides inference services for pre-made Low-Rank Adaptation (LoRA) adapters... Upload your existing LoRA adapters to run specialized i…

              Morph offers 'Reflexes' — small custom classifiers that train in ~30s on your data and are then served/gated in production (morph-docs-6, morph-docs-3, morph-docs-4) — plus dedicated endpoints to reserve capacity for a chosen model (morph-docs-15). This is a narrow, specialized form of 'train on your data and serve it' rather than fine-tuning a general-purpose base chat/completion model. Missing for 10: explicit fine-tuning API/pipeline for full base language models (not just small classifiers), documentation on custom dataset upload/training for chat models, and evidence that a fine-tuned base model (vs. a Reflex classifier) can be served alongside the standard endpoints.

              • [claimed-docs] A small Reflex trains in about 30 seconds.
              • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
              • [claimed-docs] A canary keeps your current provider, sends a slice of production traffic to Kimi K3, and compares Reflex results before you switch.
              • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it
            2. ml-engineerUpload and serve my own custom model weights or LoRA adapters

              weight 2 · round to Groq

              Groq's docs explicitly describe LoRA adapter upload and serving ('Upload your existing LoRA adapters to run specialized inference' — groq-docs-11/20/32), directly matching part of the story. However, evidence only covers LoRA adapters on top of existing base models, not uploading fully custom model weights, and there's no independent/hands-on confirmation of this LoRA workflow actually working in practice. Missing for 10: evidence of custom full-weight model upload/serving, and independent corroboration that LoRA upload works reliably in production.

              • [claimed-docs] Upload your existing LoRA adapters to run specialized inference while maintaining the performance and efficiency of Groq's infrastructure.
              • [claimed-docs] With LoRA inference on Groq, you can: Run inference with your pre-made LoRA adapters
              • [claimed-docs] Groq provides inference services for pre-made Low-Rank Adaptation (LoRA) adapters... Upload your existing LoRA adapters to run specialized i…
              Morphnone0/10

              Morph's docs describe serving open-weight chat models, dedicated capacity reservations, and training small in-house 'Reflex' classifiers, but nothing about ml-engineers uploading their own custom model weights or LoRA adapters for serving. missing for 10: any weight/adapter upload API, LoRA fine-tuning support, or documentation of bringing custom checkpoints to Morph's serving layer.

              • [claimed-docs] A small Reflex trains in about 30 seconds.
              • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it
              • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools

            Model catalog — stories about model catalog in this arenaModel catalog

            Stories about model catalog in this arena

            Catalog

            1. ml-engineerGet newly released open-weight models on the platform quickly after their public release

              weight 2 · round to Groq

              Groq's docs list several open-weight models (e.g. GPT-OSS 120B, Llama, Mixtral) and community reports mention using Kimi K2 'fast' shortly after its release, suggesting some open-weight models are added promptly, but there is no explicit documentation of a release-to-availability SLA or a systematic track record of rapid onboarding. Missing for 10: explicit timeline commitments or a changelog showing new open-weight model releases added within days, and independent verification beyond a single anecdote.

              • [claimed-docs] GPT-OSS 120B is OpenAI's flagship open-weight language model with 120 billion parameters, built in browser search and code execution, and re…
              • [community] I wanted to use Kimi K2 fast for coding and Groq was the only fast provider at the time... Definitely recommend cerebras tho now that groq's…
              • [claimed-docs] Upload your existing LoRA adapters to run specialized inference while maintaining the performance and efficiency of Groq's infrastructure.
              Morphnone0/10

              The evidence shows Morph supports a curated set of open-weight chat models (e.g., Kimi K3) and offers OpenAI/Anthropic-compatible access, but there is no documentation or report about how quickly new open-weight model releases are added to the platform. A community comment even questions why only an older model was listed on OpenRouter, suggesting possible lag, but this is not a concrete contradiction of a specific claim. Missing for 10: any release-cadence documentation, changelog, or independent confirmation of rapid onboarding of newly released open-weight models.

              • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
              • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
              • [community] Last time I looked into Morph, I noticed you weren't yet on OpenRouter. I see that's changed, but it looks like only an older model is liste…
            2. developerRely on a documented deprecation policy with advance notice before a hosted model is removed

              weight 1 · round drawn
              Groqnone0/10

              No evidence pack item documents a deprecation policy, sunset timeline, or advance-notice commitment for hosted models being removed; community comments even reference abrupt shifts (e.g., new models moved to 'call us for quotes') without formal notice process. This is a fair question for a model-hosting API but no supporting documentation exists.

              • [community] As soon as i saw they switched to 'call us for quotes' for the new models, i knew they are over.
              Morphnone0/10

              No evidence of any documented deprecation policy or advance-notice commitment for hosted models; docs cover model capabilities, migration, and endpoints but nothing about model lifecycle/removal notice.

              • ai-native userHave an agent enumerate the live model catalog programmatically via a documented GET /v1/models-style endpoint

                weight 2 · round to Groq

                Groq exposes an OpenAI-compatible /v1/models endpoint (confirmed live via probe returning JSON error structure, not 404), and docs establish OpenAI SDK/client compatibility with base_url https://api.groq.com/openai/v1, which per OpenAI spec includes the models list endpoint; this is documented and independently verified via a real GET request. missing for 10: no explicit Groq-authored documentation page specifically describing the /v1/models endpoint response schema, and no successful authenticated enumeration example shown (only the 401 unauthenticated probe).

                • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …
                • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
                • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
                • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
                Morphnone0/10

                Morph documents an OpenAI-compatible base URL (/v1) and multiple endpoints (/v1/messages, batch, caching, dedicated endpoints) but no evidence pack item mentions a GET /v1/models catalog endpoint, and the OpenAPI schema probe returned 404s across all candidate paths, meaning no documented machine-readable catalog listing was found.

                • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…
              • developerChoose among a broad catalog of current open-weight model families (Llama, Qwen, DeepSeek, GPT-OSS and peers) on shared serverless endpoints

                weight 3 · round to Groq

                Groq's docs confirm OpenAI-compatible serverless endpoints hosting multiple model families, explicitly naming GPT-OSS 120B and (via community reports) Llama and Mixtral models, but the evidence pack never mentions Qwen or DeepSeek being hosted, so the 'broad catalog' claim is only partially substantiated. missing for 10: explicit documentation of Qwen and DeepSeek model availability, and a public model list/catalog page confirming breadth beyond GPT-OSS/Llama/Mixtral.

                • [claimed-docs] GPT-OSS 120B is OpenAI's flagship open-weight language model with 120 billion parameters, built in browser search and code execution, and re…
                • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
                • [community] Incredible tool. The Mixtral 8x7B model running on their hardware did 491.40 T/s for me…
                • [community] I'm achieving consistent 450+ tokens/sec for Mixtral 8x7b 32k and ~200 tps for Llama 2 70B-4k.
                • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …

                Morph's docs confirm an OpenAI-compatible endpoint serving 'open-weight chat models' broadly, with prefix caching enabled for 'every open source model' and specific mention of migrating between providers like Kimi K3, but no evidence explicitly lists Llama, Qwen, DeepSeek, GPT-OSS or enumerates a broad multi-family catalog. Missing for 10: an explicit model catalog/list naming specific open-weight families (Llama, Qwen, DeepSeek, GPT-OSS), and independent confirmation of catalog breadth beyond Kimi K3.

                • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
                • [claimed-docs] Prefix caching is on for every open source model. No configuration, no cache-write surcharge.
                • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.

              Multimodal — stories about multimodal in this arenaMultimodal

              Stories about multimodal in this arena

              Modalities

              1. developerGenerate embeddings (and rerank results) for retrieval pipelines without a second vendor

                weight 1 · round drawn
                Groqnone0/10

                No evidence of an embeddings endpoint or reranking model/API in Groq's documentation; the evidence pack covers chat completions, tool use, transcription, LoRA, batch, and service tiers but never mentions embeddings or rerank capabilities.

                  Morphnone0/10

                  Morph's evidence focuses on chat completions, Fast Apply code editing, compaction, batch processing, caching, and dedicated endpoints — none of the docs mention embeddings generation or reranking capabilities for retrieval pipelines.

                  • developerCall vision, audio, or image-generation models beyond text chat on the same platform

                    weight 1 · round to Groq

                    Groq's docs confirm audio transcription (Whisper models via groq-gh-2) and vision input support through the Responses API (text and image inputs, groq-docs-13), extending beyond pure text chat. However, there is no evidence of image-generation models or text-to-speech/audio-generation capability on the platform. missing for 10: image-generation model support, audio-generation/TTS support, independent hands-on confirmation of multimodal calls.

                    • [github] await client.audio.transcriptions.create({ model: 'whisper-large-v3-turbo', file: fs.createReadStream('/path/to/file'), });
                    • [claimed-docs] The Responses API supports both text and image inputs while producing text outputs, stateful conversations, and function calling to connect …
                    • [claimed-docs] Groq's Responses API is fully compatible with OpenAI's Responses API, making it easy to integrate advanced conversational AI capabilities in…
                    Morphnone0/10

                    All evidence describes Morph as a text/code-focused LLM API platform (chat completions, Fast Apply code editing, Reflexes classifiers, batch/caching) with no mention of vision, audio, or image-generation model endpoints. This axis applies to an LLM API platform, but no evidence supports multimodal capability.

                    Openai compat — stories about openai compat in this arenaOpenai compat

                    Stories about openai compat in this arena

                    Compat

                    1. ai-native userPlug the provider into coding agents and agent frameworks through documented, first-party integration guides

                      weight 2 · round to Morph

                      Groq's docs clearly document OpenAI-compatible base_url swapping (groq-docs-2/25), tool-use/function-calling (groq-docs-5/27), a Responses API that is 'fully compatible with OpenAI's Responses API' (groq-docs-23), and first-party remote MCP server support where 'Groq handles all orchestration' (groq-docs-6/17/28, groq-probe-4) — all of which make it straightforward to plug into agent frameworks that speak the OpenAI protocol or MCP. However, there are no named first-party guides for specific coding-agent/agent-framework integrations (e.g., LangChain, Cursor, AutoGPT) beyond the generic OpenAI-compat pointer, and community reports flag real-world reliability quirks (groq-comm-12/13/14) that add friction beyond the docs' 'simple to integrate' framing. Missing for 10: named integration guides for specific agent frameworks/coding agents, and independent hands-on confirmation of smooth agent-framework plug-in.

                      • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
                      • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
                      • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
                      • [claimed-docs] To use tools, the model must be provided with tool definitions. These tool definitions are in JSON schema format and are passed to the model…
                      • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                      • [claimed-docs] you simply point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                      • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
                      • [claimed-docs] Groq's Responses API is fully compatible with OpenAI's Responses API, making it easy to integrate advanced conversational AI capabilities in…
                      • [probe] official MCP server documented at https://console.groq.com/docs/mcp
                      • [community] My company had a really terrible experience trying to use Groq, and I would NOT recommend anyone use their service if you need reliability. …
                      • [community] I don't really get the value proposition of groq as a user, the performance is really poor for the token price.
                      Morphfullprobed8/10

                      Morph provides first-party documented guides for integrating with coding agents/frameworks: OpenAI-compatible endpoint (morph-docs-1), native Anthropic Messages API for Claude Code (morph-docs-7), MCP server setup for Claude Code (morph-docs-5, morph-docs-9, morph-probe-4), and Codex integration via edit_file (morph-docs-8). Community evidence (goose author, HN discussion) corroborates real-world use in agent frameworks. Missing for 10: independent verification of MCP/agent integration reliability beyond docs and mixed community feedback on apply accuracy.

                      • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                      • [claimed-docs] Install the Morph MCP so Claude Code can read it
                      • [claimed-docs] Claude Code speaks the Anthropic Messages API, which Morph serves natively at `/v1/messages`.
                      • [claimed-docs] Keep your current Codex model and give it `edit_file` backed by `morph-v3-fast` at 10,500+ tok/s
                      • [claimed-docs] Connect your favorite AI tools to Morph's blazing-fast file editing via Model Context Protocol.
                      • [probe] official MCP server documented at https://docs.morphllm.com/guides/mcp
                      • [community] Have been using morph for a while (I am one of the authors of goose) and was surprised when introduced at the boost it gave me (much less it…
                    2. ai-native userHave an agent switch to or away from this provider mid-workflow because it speaks the standard chat-completions API without provider-specific code changes

                      weight 3 · round drawn

                      Groq's docs explicitly instruct developers to reuse OpenAI client libraries by just swapping api_key and base_url to https://api.groq.com/openai/v1, and this is corroborated by a live probe showing the OpenAI-style /v1/models endpoint responding in the expected JSON error format. Chat completions, streaming, tool-use, and structured outputs are all documented against this same OpenAI-compatible surface, supporting drop-in provider switching mid-workflow. Missing for 10: independent/hands-on confirmation from a real agent framework that switching providers requires zero code changes, and clarity on any OpenAI parameters/features that are NOT supported (full parity claim not verified end-to-end).

                      • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
                      • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
                      • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
                      • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …
                      • [claimed-docs] Generating text with Groq's Chat Completions API enables you to have natural, conversational interactions with Groq's large language models.
                      Morphfullprobed8/10

                      Morph explicitly documents an OpenAI-compatible endpoint (and Anthropic Messages compatibility) plus first-class provider-switching workflows—canary traffic splits and full migration from OpenAI/Anthropic to another model—showing the standard API enables mid-workflow provider switches without code changes. Community evidence (morph-comm-5) independently confirms the OpenAI-compatible endpoint works with third-party tools. missing for 10: independent hands-on verification of the canary/migration switching feature itself (only vendor docs), and no evidence of switching away from Morph to another provider.

                      • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                      • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
                      • [claimed-docs] A canary keeps your current provider, sends a slice of production traffic to Kimi K3, and compares Reflex results before you switch.
                      • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
                      • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
                      • [community] This uses an OpenAI-compatible endpoint, so got this working with my llm.datasette.io CLI tool... One thing that worries me: since it's usin…
                    3. developerPoint an existing OpenAI SDK client at the provider by changing only the base URL and API key

                      weight 3 · round to Groq

                      Groq's docs explicitly instruct developers to point OpenAI SDK clients at Groq by only changing api_key and base_url to https://api.groq.com/openai/v1, and a live probe confirms the OpenAI-style /v1/models endpoint is functional. This is corroborated by consistent documentation across chat completions, streaming, tool use, and structured outputs all using OpenAI SDK conventions. Missing for 10: independent third-party confirmation of a drop-in swap working flawlessly in production (community evidence focuses on speed/reliability rather than compatibility specifics).

                      • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
                      • [claimed-docs] To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.g…
                      • [probe] PROBE models-endpoint (2026-09-04): GET https://api.groq.com/openai/v1/models without a key returned HTTP 401 ({"error":{"message":"Invalid …
                      • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
                      Morphfullprobed8/10

                      Docs explicitly state to point any OpenAI SDK at https://api.morphllm.com/v1 with a single API key, corroborated by a probe confirming the llms.txt describes it as OpenAI-compatible, and community evidence confirms it was actually wired up with an OpenAI-compatible client tool. missing for 10: independent hands-on confirmation of a truly drop-in swap with zero code changes beyond base URL/key, and no official OpenAPI spec found to verify full compatibility surface.

                      • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                      • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
                      • [community] This uses an OpenAI-compatible endpoint, so got this working with my llm.datasette.io CLI tool... One thing that worries me: since it's usin…

                    Openness — open source, data portability, and self-hosting storiesOpenness

                    Open source, data portability, and self-hosting stories

                    1. ai-native userDo everything through the API that I can do in the UI

                      weight 2 · round to Groq

                      Groq's API surface covers essentially all the model-facing capabilities shown in its console/docs — chat completions, streaming, tool use, structured outputs, batch processing, service tiers, LoRA inference, and MCP remote tool use are all documented as API features (groq-docs-2,5,6,7,8,11,16,28). However, account/billing controls like spend limits (groq-docs-12/24) appear to be console-only with no documented API equivalent, and the probe found no public OpenAPI spec (all candidate paths 404, groq-probe-3), making it unclear whether the full API surface is discoverable/self-describing the way the UI is. Missing for 10: API-based management of billing/spend limits, a published OpenAPI/schema confirming full UI-API parity, and independent confirmation that every console feature (e.g., playground-only settings) has an API equivalent.

                      • [claimed-docs] pass your Groq API key to the `api_key` parameter and change the `base_url` to `https://api.groq.com/openai/v1`
                      • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
                      • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                      • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
                      • [claimed-docs] Upload your existing LoRA adapters to run specialized inference while maintaining the performance and efficiency of Groq's infrastructure.
                      • [claimed-docs] Structured Outputs is a feature that ensures your model responses conform to your provided JSON Schema
                      • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
                      • [claimed-docs] Spend Limits: Set automated spending limits and receive budget alerts
                      • [probe] PROBE openapi: all candidate paths 404 (https://console.groq.com/openapi.json, https://console.groq.com/swagger.json, https://console.groq.c…

                      Morph is fundamentally API-first — nearly all documented functionality (chat completions, Fast Apply, Compact, Reflexes, batch, dedicated endpoints, MCP) is exposed via the API/SDK per morph-docs-1 through morph-docs-16, and a playground/dashboard UI is only mentioned in passing (morph-comm-2). There's no explicit documentation enumerating dashboard-only features (billing, endpoint provisioning UI, playground testing) and confirming each has an API equivalent, so full parity isn't demonstrated. Missing for 10: explicit UI/dashboard feature list mapped to API endpoints, confirmation that account/billing/endpoint-management actions available in the dashboard are also API-accessible, and independent verification of parity.

                      • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                      • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it
                      • [community] Seems completely broken. I used the provided HTML example on morphllm.com playground. Without editing anything, I pressed apply. Your model …
                      • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
                    2. ai-native userExport all of my data in open formats and leave

                      weight 3 · round drawn
                      Groqnone0/10

                      Groq's docs cover API usage, models, tool-use, batch processing and billing, but nothing addresses exporting account data, conversation history, or batch outputs in open/portable formats, nor any account-closure data dump. Even though Groq's Responses API is 'stateful,' there is no documented export or data-portability mechanism.

                        Morphnone0/10

                        No evidence of a data export feature or open-format export of user data/history; Morph is an API/tooling platform for code editing and model access, but nothing addresses exporting stored user data for portability or account exit.

                        • ai-native userRead the product's source under an open license

                          weight 2 · round drawn
                          Groqnone0/10

                          The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

                            Morphnone0/10

                            Morph is a hosted API/SaaS product; no evidence of an open-license source repository for the core product (morph-demos is just example code, not the product source). No license or open-source claim appears anywhere in the evidence pack.

                            Pricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limits

                            Free-tier ceilings, usage caps, and rate limits before you have to pay

                            Limits

                            1. developerRead documented rate limits and how they scale across usage tiers before I hit them in production

                              weight 2 · round to Groq

                              Groq's docs describe multiple service tiers (on-demand, flex, auto) and note Flex Processing gives '10x higher rate limits' for paid customers, plus batch processing having 'no impact to your standard rate limits' and spend-limit alerts — showing tiered scaling exists and is documented at a high level. However, no evidence pack citation shows a dedicated rate-limits page with concrete numeric request/token-per-minute limits per tier (free vs paid vs flex), so a developer can't get exact production-planning numbers from what's cited. Missing for 10: a documented numeric rate-limit table per usage tier, and independent confirmation that these documented limits match real-world behavior.

                              • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability.
                              • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing.
                              • [claimed-docs] Flex Processing is a service tier optimized for high-throughput workloads that prioritizes fast inference and can handle occasional request …
                              • [claimed-docs] auto: Pass this if you dont want to think about tiers and you want to leverage the best tier available to you at any given moment.
                              • [claimed-docs] Batch processing lets you run thousands of API requests at scale by submitting your workload as an asynchronous batch of requests to Groq wi…
                              • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing. Pricing mat…
                              • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability. You can distinguish these by providing the serv…
                              • [claimed-docs] Spend Limits:** Set automated spending limits and receive budget alerts
                              Morphnone0/10

                              The evidence mentions rate limits exist (morph-docs-16: 'same open source chat models, token billing, and rate limits') but never documents actual limit numbers, tiers, or how they scale with usage — no pricing/tier table or rate-limit reference is shown. Missing for 10: an actual rate-limit table or tier breakdown, numeric thresholds, and documentation on how limits change across plans.

                              • [claimed-docs] Anthropic Messages supports the same open source chat models, token billing, and rate limits.
                              • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it

                            Pricing

                            1. founderSet spending caps or budget alerts so a runaway workload cannot generate an unbounded bill

                              weight 1 · round to Groq

                              Groq's billing docs explicitly state users can set automated spending limits and receive budget alerts, directly matching the story. Missing for 10: no independent/hands-on corroboration of the spend-limit UI actually working, and no detail on granularity (per-project vs account-wide) or alert channels.

                              • [claimed-docs] Spend Limits: Set automated spending limits and receive budget alerts
                              • [claimed-docs] Spend Limits:** Set automated spending limits and receive budget alerts
                              Morphnone0/10

                              No evidence pack item mentions spending caps, budget alerts, usage limits, or billing controls of any kind; docs focus on models, tools, and pricing mechanics like batch/cache but not cap-setting features. This axis applies to any paid API/cloud product but no capability is documented, so it's 'none' rather than 'na'.

                              • founderSee public per-token prices for every hosted model without talking to sales

                                weight 3 · round to Groq

                                Groq's docs discuss billing mechanics (spend limits, flex-processing pricing parity, batch discount) implying a public pricing model, but no evidence pack item shows an actual public per-token price sheet for every hosted model, and a community report explicitly states Groq switched to 'call us for quotes' for newer models, contradicting the claim of fully public pricing without sales contact. Missing for 10: an actual public pricing page listing per-token rates for each model, and confirmation that newer/premium models are not gated behind sales quotes.

                                • [claimed-docs] Spend Limits: Set automated spending limits and receive budget alerts
                                • [claimed-docs] Spend Limits:** Set automated spending limits and receive budget alerts
                                • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing. Pricing mat…
                                • [community] As soon as i saw they switched to 'call us for quotes' for the new models, i knew they are over.
                                • [community] Very impressive! I am even more impressed by the API pricing though - 0.27/1M tokens seems like an order of magnitude cheaper than the GPT-3…
                                Morphnone0/10

                                No evidence pack item shows a public pricing page or per-token price list; docs mention batch pricing at 'half price' and mention of a 'plan' for dedicated endpoints but no explicit public per-token rates are cited, and no pricing page was probed or found.

                                Privacy posture — data-handling and privacy storiesPrivacy posture

                                Data-handling and privacy stories

                                1. ai-native userChoose where my data is stored (region/residency)

                                  weight 2 · round drawn
                                  Groqnone0/10

                                  No evidence in the pack mentions data residency, region selection, or geographic storage controls anywhere in Groq's docs, GitHub, or community discussion.

                                    Morphnone0/10

                                    No evidence in the pack mentions data residency, regional storage options, or geographic controls; the closest is a comment about retention/training policy tiers (morph-comm-6), which is about usage not location. Missing for 10: any documentation of region selection, data residency guarantees, or geo-specific hosting options.

                                    • [community] Please clarify your privacy policy. If my interpretation is correct, paying users will have their data retained and trained on? ... Free Tie…
                                  • ai-native userPrevent my data from being used to train AI models

                                    weight 3 · round to Morph
                                    Groqnone0/10

                                    No evidence pack item addresses data usage/training policies, opt-out controls, or privacy commitments regarding whether user data is used to train Groq's models.

                                      A community-sourced excerpt of Morph's privacy policy (morph-comm-6) shows Enterprise Tier users can opt out of having code/data used for training, satisfying the story, but Free Tier data is explicitly used to train models by default — a significant caveat requiring a paid tier to actually prevent training use. No first-party Morph docs in the evidence pack directly address data retention/training opt-out. Missing for 10: first-party documentation of the privacy/data-use policy and opt-out mechanism, independent confirmation that Enterprise-tier exclusion is honored in practice.

                                      • [community] Please clarify your privacy policy. If my interpretation is correct, paying users will have their data retained and trained on? ... Free Tie…
                                    • ai-native userControl data retention and deletion

                                      weight 2 · round drawn
                                      Groqnone0/10

                                      No evidence pack items address data retention policies, deletion controls, or user-facing privacy/data management settings for Groq's API; the docs focus on inference features, tooling, pricing, and rate limits with nothing on retention/deletion.

                                        Morphnone0/10

                                        Evidence only shows a general privacy-policy statement about free vs enterprise data usage (morph-comm-6), with a community member explicitly asking for clarification — there is no documented user-facing control for data retention settings or deletion requests. Missing for 10: any docs on data retention windows, user-initiated deletion/export tools, or enterprise data handling guarantees beyond the raw policy snippet.

                                        • [community] Please clarify your privacy policy. If my interpretation is correct, paying users will have their data retained and trained on? ... Free Tie…
                                      • ai-native userOpt out of telemetry and usage tracking

                                        weight 2 · round to Morph
                                        Groqnone0/10

                                        No evidence pack item addresses telemetry, usage tracking, opt-out settings, or privacy controls for Groq's API or console; the docs cover inference features, pricing, and infra but nothing about data collection preferences.

                                          Community evidence indicates a tiered privacy policy where free-tier code may be used for training while Enterprise-tier data is not used beyond immediate processing, implying paying/enterprise users can effectively opt out of data usage — but there is no explicit telemetry/usage-tracking opt-out control or documentation for individual users. missing for 10: explicit telemetry opt-out toggle/setting, first-party privacy documentation confirming opt-out mechanics, independent confirmation beyond a single HN comment.

                                          • [community] Please clarify your privacy policy. If my interpretation is correct, paying users will have their data retained and trained on? ... Free Tie…

                                        Reliability status — stories about reliability status in this arenaReliability status

                                        Stories about reliability status in this arena

                                        Reliability

                                        1. founderGet a stated availability SLA on paid or enterprise tiers

                                          weight 1 · round drawn
                                          Groqnone0/10

                                          Evidence shows service tiers, flex processing, and a public status page, but nowhere is there a stated uptime/response-time SLA commitment for paid or enterprise customers; enterprise tiers are only referenced via 'call us for quotes' community comments with no SLA terms disclosed.

                                          • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability.
                                          • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability. You can distinguish these by providing the serv…
                                          • [probe] PROBE status-page (2026-09-04): https://groqstatus.com returns HTTP 200 and renders a public service-status page (page body includes "operat…
                                          • [community] As soon as i saw they switched to 'call us for quotes' for the new models, i knew they are over.
                                          Morphnone0/10

                                          No evidence pack item mentions an SLA, uptime commitment, or reliability guarantee for paid/enterprise tiers — dedicated endpoints and enterprise privacy terms are mentioned but no stated availability percentage or SLA terms are documented.

                                          • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it
                                          • [community] Please clarify your privacy policy. If my interpretation is correct, paying users will have their data retained and trained on? ... Free Tie…
                                        2. founderCheck a public status page with incident history before betting production traffic on the platform

                                          weight 2 · round to Groq

                                          A probe confirms a live public status page at groqstatus.com that returns HTTP 200 and shows 'operational' status, indicating Groq does operate a status page a founder could check before committing production traffic. However, the evidence doesn't confirm the page includes detailed incident history, uptime history, or granular component-level status, and there's no first-party documentation describing the status page's features. missing for 10: confirmation of incident history/log on the status page, documented SLA or uptime commitments, and independent corroboration beyond a single automated probe.

                                          • [probe] PROBE status-page (2026-09-04): https://groqstatus.com returns HTTP 200 and renders a public service-status page (page body includes "operat…
                                          Morphnone0/10

                                          No evidence of a public status page or incident history for Morph anywhere in the pack; only docs, demos, and community discussion threads are present. missing for 10: a public status page URL, uptime/incident history, SLA commitments.

                                          Speed latency — stories about speed latency in this arenaSpeed latency

                                          Stories about speed latency in this arena

                                          Benchmarks

                                          1. ml-engineerSee published tokens-per-second or latency numbers, benchmarks, or load-testing guides backing the provider's speed claims

                                            weight 2 · round to Morph

                                            There is no first-party published benchmark or load-testing page in the evidence (docs cover service tiers, flex processing, batch, streaming, but no concrete TPS/latency numbers or methodology). Independent hands-on community reports do supply concrete numbers (491 T/s and 450+ TPS for Mixtral, deterministic low-latency architecture claims) supporting the speed claim, but later community threads directly contradict this, calling performance 'really poor for the token price' and reliability 'worse than traditional hosts' with frequent errors. Missing for 10: an official Groq benchmark/load-testing page with methodology, and resolution of the conflicting recent community performance complaints.

                                            • [community] Incredible tool. The Mixtral 8x7B model running on their hardware did 491.40 T/s for me…
                                            • [community] I'm achieving consistent 450+ tokens/sec for Mixtral 8x7b 32k and ~200 tps for Llama 2 70B-4k.
                                            • [community] Groq AMA: 'Unlike with graphics processors, which really need data parallelism to get good throughput, our LPU architecture allows us to del…
                                            • [community] Groq staff: our system is deterministic, no need for waiting or queuing anywhere, and we can have very low latency interconnect between card…
                                            • [community] There's a trail of complaints going back years now, and they rounded out the bottom of Kimi's verification program. Groq hosted models were/…
                                            • [community] I don't really get the value proposition of groq as a user, the performance is really poor for the token price.
                                            • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability.
                                            • [claimed-docs] Flex processing is available for all models to paid customers only with 10x higher rate limits compared to on-demand processing.

                                            Morph publishes specific throughput numbers (10,500+ tok/s Fast Apply, 33,000 tok/s Compact, 90ms classifiers, 30s Reflex training) across its docs and even one independent community post corroborates a speed/iteration boost, but there is no independent benchmark suite, third-party load-testing report, or reproducible methodology, and one community report describes inaccurate output rather than confirming throughput. missing for 10: independent benchmark/load-testing reports, published methodology or test conditions behind the tok/s figures, and resolution of the community accuracy complaint.

                                            • [claimed-docs] Keep your current Codex model and give it `edit_file` backed by `morph-v3-fast` at 10,500+ tok/s
                                            • [claimed-docs] Fast Apply merges just the changed lines at 10,500 tok/s, 98% accuracy.
                                            • [claimed-docs] Drop filler from chat history and code context at 33,000 tok/s. 50-70% reduction, every surviving line byte-for-byte identical to input.
                                            • [claimed-docs] Small text classifiers that label a turn in ~90ms — jailbreaks, NSFW, stuck-in-a-loop, user frustration.
                                            • [claimed-docs] A small Reflex trains in about 30 seconds.
                                            • [github] Use Morph's API to intelligently modify existing code at 4,500+ tokens/sec
                                            • [community] Have been using morph for a while (I am one of the authors of goose) and was surprised when introduced at the boost it gave me (much less it…
                                            • [community] Seems completely broken. I used the provided HTML example on morphllm.com playground. Without editing anything, I pressed apply. Your model …

                                          Serving

                                          1. developerServe latency-sensitive workloads with fast time-to-first-token and high-throughput generation

                                            weight 3 · round to Morph

                                            Early hands-on community reports strongly corroborate Groq's speed claims (491 T/s and ~450 t/s on Mixtral, deterministic low-latency architecture, streaming support docs), and Groq documents service tiers/flex-processing explicitly for latency/throughput tuning. However, more recent independent reports directly contradict this, describing Groq's hosted model performance as 'really poor for the token price' and 'always worse than traditional hosts,' plus reliability complaints ('so many random errors'), which concretely undercuts the fast/high-throughput positioning for current models. Missing for 10: recent (not 2024-era) throughput benchmarks, first-party TTFT numbers, and resolution of the conflicting recent user reports on performance-for-price.

                                            • [community] Incredible tool. The Mixtral 8x7B model running on their hardware did 491.40 T/s for me…
                                            • [community] I'm achieving consistent 450+ tokens/sec for Mixtral 8x7b 32k and ~200 tps for Llama 2 70B-4k.
                                            • [community] Groq AMA: 'Unlike with graphics processors, which really need data parallelism to get good throughput, our LPU architecture allows us to del…
                                            • [community] Groq staff: our system is deterministic, no need for waiting or queuing anywhere, and we can have very low latency interconnect between card…
                                            • [claimed-docs] Groq offers multiple service tiers so you can tune for latency, throughput, and reliability.
                                            • [claimed-docs] Flex Processing is a service tier optimized for high-throughput workloads that prioritizes fast inference and can handle occasional request …
                                            • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas
                                            • [community] My company had a really terrible experience trying to use Groq, and I would NOT recommend anyone use their service if you need reliability. …
                                            • [community] There's a trail of complaints going back years now, and they rounded out the bottom of Kimi's verification program. Groq hosted models were/…
                                            • [community] I don't really get the value proposition of groq as a user, the performance is really poor for the token price.

                                            Morph publishes concrete high-throughput numbers (10,500+ tok/s Fast Apply, 33,000 tok/s Compact, ~90ms classifiers, prefix caching with no surcharge) aimed squarely at low-latency/high-throughput serving, and independent community use (goose author) corroborates a real speed boost in practice. Missing for 10: explicit time-to-first-token benchmarks and independent third-party throughput verification beyond vendor docs and one anecdotal HN comment.

                                            • [claimed-docs] Keep your current Codex model and give it `edit_file` backed by `morph-v3-fast` at 10,500+ tok/s
                                            • [claimed-docs] Fast Apply merges just the changed lines at 10,500 tok/s, 98% accuracy.
                                            • [claimed-docs] Drop filler from chat history and code context at 33,000 tok/s. 50-70% reduction, every surviving line byte-for-byte identical to input.
                                            • [claimed-docs] Small text classifiers that label a turn in ~90ms — jailbreaks, NSFW, stuck-in-a-loop, user frustration.
                                            • [claimed-docs] Prefix caching is on for every open source model. No configuration, no cache-write surcharge.
                                            • [community] Have been using morph for a while (I am one of the authors of goose) and was surprised when introduced at the boost it gave me (much less it…
                                          2. ml-engineerBenefit from prompt/prefix caching that reduces latency or cost on repeated context

                                            weight 1 · round to Morph
                                            Groqnone0/10

                                            No evidence pack item mentions prompt/prefix caching, context caching, or any discounted repeated-context pricing on Groq's API. Docs cover streaming, batch processing, service tiers, and flex processing, but none describe caching repeated prompt prefixes to cut latency or cost, so this applicable axis is unaddressed.

                                              Morph docs explicitly state prefix caching is enabled by default for all open-source models with no configuration and no cache-write surcharge, directly addressing latency/cost reduction on repeated context. Missing for 10: independent benchmark or community corroboration of actual latency/cost savings from caching specifically (community evidence covers Fast Apply speed, not caching).

                                              • [claimed-docs] Prefix caching is on for every open source model. No configuration, no cache-write surcharge.
                                            • developerStream completions token by token over SSE for responsive user experiences

                                              weight 3 · round to Groq

                                              Docs explicitly document setting stream=True for token-by-token delta streaming via the OpenAI-compatible API, aligned with real-time display use cases, and independent community testimonials corroborate very high token throughput consistent with responsive streaming UX. Missing for 10: explicit confirmation of SSE transport format (docs describe iterator/deltas but don't spell out 'SSE' verbatim) and no independent hands-on benchmark specifically of streaming latency/SSE behavior.

                                              • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas
                                              • [claimed-docs] To enable streaming, set the parameter `stream=True`.
                                              • [claimed-docs] you can stream the model's response in real-time. This allows your application to display the response as it's being generated
                                              • [claimed-docs] To enable streaming, set the parameter stream=True. The completion function will then return an iterator of completion deltas rather than a …
                                              • [community] Incredible tool. The Mixtral 8x7B model running on their hardware did 491.40 T/s for me…
                                              • [community] I'm achieving consistent 450+ tokens/sec for Mixtral 8x7b 32k and ~200 tps for Llama 2 70B-4k.
                                              • [community] Very impressed with the speed. This is one of the most impressive tech demos I've ever seen in my life... surreal to see the thing spitting …

                                              Morph advertises full OpenAI SDK/API compatibility at api.morphllm.com/v1 (morph-docs-1), which implies standard streaming support, but no evidence explicitly documents SSE/token-by-token streaming, a `stream` parameter, or any latency/responsiveness benchmarks for streamed output. missing for 10: explicit docs or examples showing `stream=true`/SSE usage, first-party or community confirmation of token-by-token streaming behavior, and any measured time-to-first-token metrics.

                                              • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                                              • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…

                                            Structured tool calling — stories about structured tool calling in this arenaStructured tool calling

                                            Stories about structured tool calling in this arena

                                            Structured

                                            1. developerEnforce structured outputs against a JSON schema (or grammar) so model responses parse reliably

                                              weight 3 · round to Groq

                                              Groq's docs explicitly describe Structured Outputs with JSON Schema and a strict:true mode that uses constrained decoding to guarantee schema-conforming output, plus tool-use docs confirming JSON schema-based function calling. This is first-party documented and consistent with OpenAI-compatible API design. Missing for 10: independent/hands-on verification that strict mode reliably parses in production and no community corroboration of structured-output reliability specifically.

                                              • [claimed-docs] With strict: true, the model uses constrained decoding to guarantee that the output will always match your schema exactly.
                                              • [claimed-docs] Structured Outputs is a feature that ensures your model responses conform to your provided JSON Schema
                                              • [claimed-docs] With `strict: true`, the model uses constrained decoding to guarantee that the output will always match your schema exactly
                                              • [claimed-docs] To use tools, the model must be provided with tool definitions. These tool definitions are in JSON schema format and are passed to the model…
                                              Morphnone0/10

                                              Morph's docs cover OpenAI-compatible endpoints, Fast Apply, compaction, batch, caching, and MCP integration, but no evidence describes JSON schema/grammar-constrained structured output enforcement for reliable parsing. Missing for 10: any mention of response_format/json_schema support, grammar constraints, or validation guarantees on model outputs.

                                              Tools

                                              1. ai-native userRely on faithful function/tool calling — including parallel and multi-step tool use — so agent loops run on open models without breaking

                                                weight 3 · round drawn

                                                Groq's docs clearly document OpenAI-compatible function/tool calling (JSON-schema tool definitions, strict-mode structured outputs, and now Remote MCP where 'Groq handles all orchestration') which supports agentic tool use, but none of the evidence explicitly confirms parallel tool calls or multi-step tool-use loops working reliably. Community reports also raise reliability concerns ('so many random errors, so many silly quirks') that create some doubt about robustness for agent loops, though not a concrete tool-calling failure. missing for 10: explicit documentation/examples of parallel tool calling, multi-step agentic loop reliability testing, and independent hands-on verification that tool calls remain faithful across steps.

                                                • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
                                                • [claimed-docs] To use tools, the model must be provided with tool definitions. These tool definitions are in JSON schema format and are passed to the model…
                                                • [claimed-docs] With strict: true, the model uses constrained decoding to guarantee that the output will always match your schema exactly.
                                                • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                                                • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
                                                • [community] My company had a really terrible experience trying to use Groq, and I would NOT recommend anyone use their service if you need reliability. …
                                                • [community] There's a trail of complaints going back years now, and they rounded out the bottom of Kimi's verification program. Groq hosted models were/…

                                                Morph documents OpenAI-compatible and Anthropic Messages-compatible endpoints and specialized tools like edit_file/Fast Apply meant to plug into agent loops (Claude Code, Codex) with high speed and claimed 98% accuracy, which implies decent tool-call fidelity for open models. However there's no explicit documentation of parallel or multi-step tool-call handling, and a hands-on community report describes the apply/tool behavior as 'completely broken' with unrequested edits, undercutting full confidence in reliability. Missing for 10: explicit parallel tool-call support docs, multi-step agent-loop stability guarantees, and independent verification resolving the reported apply failures.

                                                • [claimed-docs] Claude Code speaks the Anthropic Messages API, which Morph serves natively at `/v1/messages`.
                                                • [claimed-docs] Keep your current Codex model and give it `edit_file` backed by `morph-v3-fast` at 10,500+ tok/s
                                                • [claimed-docs] Fast Apply merges just the changed lines at 10,500 tok/s, 98% accuracy.
                                                • [claimed-docs] Connect your favorite AI tools to Morph's blazing-fast file editing via Model Context Protocol.
                                                • [community] Seems completely broken. I used the provided HTML example on morphllm.com playground. Without editing anything, I pressed apply. Your model …
                                                • [community] Does Claude Code have a similar apply model? It does create diffs for you to accept/reject but then I feel like it's always using a find/rep…

                                              Not comparable on these axes

                                              1. ai-native userPlug MCP servers into this product so it can use their tools

                                                weight 3 · not comparable

                                                Groq's Responses/Chat API supports remote MCP: you provide an MCP server URL and Groq handles tool orchestration without implementing tool logic yourself, documented explicitly in first-party docs and confirmed via a probe of the dedicated MCP docs page. Missing for 10: independent hands-on user reports specifically validating MCP tool use (community evidence covers speed/reliability but not MCP), and no details on multi-server or auth edge cases.

                                                • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                                                • [claimed-docs] you simply point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                                                • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
                                                • [probe] official MCP server documented at https://console.groq.com/docs/mcp
                                                Morphn/a

                                                Morph is an LLM API/tool-serving platform (fast-apply, reflexes, model routing) that itself exposes an MCP server for other agents (e.g., Claude Code) to consume — it is not an agent host that ingests external MCP servers as tool sources. The story's client-side capability (plugging MCP servers into Morph so it can use their tools) is a category mismatch for this product type; all MCP evidence describes Morph being served TO clients, not consuming servers itself.

                                                • [claimed-docs] Install the Morph MCP so Claude Code can read it
                                                • [claimed-docs] Connect your favorite AI tools to Morph's blazing-fast file editing via Model Context Protocol.
                                                • [probe] official MCP server documented at https://docs.morphllm.com/guides/mcp
                                              2. ai-native userGet AI-generated insights and suggestions from my data inside the product

                                                weight 2 · not comparable
                                                Groqn/a

                                                Groq is a raw LLM inference API/platform (chat completions, tool use, batch processing) — it has no first-party product surface that holds 'my data' and surfaces insights/suggestions from it; that would be a downstream application built on Groq, not Groq itself.

                                                  Morphn/a

                                                  Morph is developer infrastructure (fast-apply code editing, model routing, classifiers) accessed via API/SDK/MCP, not a product with a UI surfacing AI-generated insights from a user's own data; this story targets data-analytics/BI-style products and is a category mismatch for Morph.

                                                  • ai-native userDelegate tasks to a built-in AI assistant inside the product

                                                    weight 3 · not comparable
                                                    Groqnone0/10

                                                    The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

                                                      Morphn/a

                                                      Morph is a developer-facing API/infrastructure platform (fast-apply, chat models, MCP tools) meant to be embedded into other products or coding agents — it is not itself an end-user product with a built-in assistant UI to delegate tasks to. This axis is a category error for an API/infra offering, not a missing feature.

                                                      • ai-native userOperate the product with natural-language commands

                                                        weight 2 · not comparable

                                                        Groq's Chat Completions/Responses API is inherently natural-language driven, and its tool-use and remote-MCP features let a model take autonomous actions from NL instructions, which supports agentic operation on top of the API. However, this is evidence of building NL-driven agents *with* Groq's models, not of an NL command interface for operating the Groq platform/product itself (e.g., managing keys, billing, deployments via chat). Missing for 10: an NL/chat interface for controlling the Groq platform itself, independent verification of agentic tool-use reliability in production.

                                                        • [claimed-docs] Generating text with Groq's Chat Completions API enables you to have natural, conversational interactions with Groq's large language models.
                                                        • [claimed-docs] Tool use (or function calling) is what transforms a language model from a conversational interface into an autonomous agent capable of takin…
                                                        • [claimed-docs] To use tools, the model must be provided with tool definitions. These tool definitions are in JSON schema format and are passed to the model…
                                                        • [claimed-docs] point to an MCP server URL and the Groq API will start using its tools without you having to implement any tool logic yourself
                                                        • [claimed-docs] Groq's Responses API supports remote tool use via MCP servers via HTTPS where Groq handles all orchestration... You don't implement anything…
                                                        Morphn/a

                                                        Morph is a backend model-serving/API and MCP-tool provider consumed programmatically by coding agents (Claude Code, Cursor, etc.); it is not itself a user-facing surface where an end user types natural-language commands. The natural-language interface lives in the calling agent, not in Morph, so this axis is a category mismatch for this kind of infrastructure product.

                                                        • ai-native userTest against a sandbox environment without touching production data

                                                          weight 1 · not comparable
                                                          Groqnone0/10

                                                          The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na". (na/none harmonized at arena bring-up — see pipeline/scripts/na-harmonize.ts.)

                                                            Morphn/a

                                                            Morph is an API/model-serving platform for code editing, embeddings, and agent tooling — it has no concept of a 'sandbox vs production data' environment for testing; this axis is a category error for its product type.

                                                            • ai-native userDefine rules that trigger actions automatically on events

                                                              weight 3 · not comparable
                                                              Groqn/a

                                                              Groq is an LLM inference API/platform (fast inference, tool-use, structured outputs, batch processing) — it has no workflow/automation engine for defining rules that trigger actions on events; this axis belongs to automation platforms, not an inference provider.

                                                                Morph's 'Reflexes' are classifiers that detect events (jailbreak, frustration, loop) and can gate automatic actions like canary traffic-splitting or full migration between models, which is a narrow form of event-triggered automation. However there's no documented general-purpose rule engine letting users define arbitrary custom rules/actions beyond this migration-gating use case. Missing for 10: a general user-facing rules/automation builder, documentation of broader trigger-action mappings beyond model migration, and independent confirmation of custom Reflex-to-action wiring.

                                                                • [claimed-docs] Move a production agent off Anthropic or OpenAI onto Kimi K3 — a 5% traffic trial or a full migration, gated by Reflexes.
                                                                • [claimed-docs] A canary keeps your current provider, sends a slice of production traffic to Kimi K3, and compares Reflex results before you switch.
                                                                • [claimed-docs] A small Reflex trains in about 30 seconds.
                                                              • ai-native userSchedule recurring jobs or workflows

                                                                weight 2 · not comparable
                                                                Groqn/a

                                                                Groq is an inference API/hardware provider (LLM completions, batch, tool-use, MCP) with no scheduling/orchestration layer for recurring jobs or workflows; this is a category error for the product type, not a missing feature.

                                                                  Morphnone0/10

                                                                  Morph is an API/model platform for code editing, apply, search, and agent-provider migration—no evidence of any scheduler, cron-like trigger, or recurring workflow/job execution feature in the docs or community posts.

                                                                  • ai-native userVersion, review, and roll back my automations

                                                                    weight 1 · not comparable
                                                                    Groqn/a

                                                                    Groq is an inference API/hardware provider, not an automation-builder platform; there is no concept of building 'automations' to version, review, or roll back within its product scope.

                                                                      Morphnone0/10

                                                                      Morph is an API/tooling platform for fast code editing, model routing, and reflex classifiers — there's no evidence of any versioning, review, or rollback mechanism for 'automations' (e.g., no workflow history, diff review UI for automation configs, or revert capability). Nothing in the evidence pack addresses this axis at all.

                                                                      • ai-native userSelf-host the core product

                                                                        weight 3 · not comparable
                                                                        Groqn/a

                                                                        Groq is a hosted inference API/cloud service built on proprietary LPU hardware; there is no evidence (or plausibility) of a self-hostable core product, as the value proposition is entirely tied to Groq's own datacenter hardware. Self-hosting is a category error for this product type, not a missing feature.

                                                                        • [community] The main problem with the Groq LPUs is they don't have any HBM at all, just 230 MiB of SRAM, meaning you need ~256 LPUs (4 full server racks…
                                                                        • [claimed-docs] Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
                                                                        Morphnone0/10

                                                                        Morph is presented entirely as a hosted API/SaaS product (api.morphllm.com endpoints, dedicated endpoints as reserved capacity, prefix caching, batch processing) with no mention of on-premises deployment, downloadable server binaries, Docker images, or open-source release of the core service. Evidence pack contains no self-hosting instructions or claims.

                                                                        • [claimed-docs] Point any OpenAI SDK at `https://api.morphllm.com/v1`. One API key covers the open-weight chat models and the specialized tools
                                                                        • [claimed-docs] Reserve model capacity by choosing a model and plan. Morph provisions and operates it
                                                                        • [probe] PROBE llms.txt: HTTP 200 at https://docs.morphllm.com/llms.txt # Morph API Documentation > https://docs.morphllm.com > Base URL: https://api…
                                                                        • [probe] PROBE openapi: all candidate paths 404 (https://docs.morphllm.com/openapi.json, https://docs.morphllm.com/swagger.json, https://docs.morphll…