Skip to content

AI Assistants Arena

Gemini vs Muse

Gemini wins · 312 (8 drawn)

Agenticness — how well agents can access and operate the productAgenticness

How well agents can access and operate the product

Agent access

  1. ai-native userPlug MCP servers into this product so it can use their tools

    weight 3 · round drawn
    Gemininone0/10

    Evidence covers Gemini Apps' 'Connected Apps' feature (Gmail, Calendar, Maps, Flights) and coding-related uploads (GitHub repos, folders), but nothing describes plugging in Model Context Protocol (MCP) servers as a tool-connection mechanism. Missing for 10: any documentation or mention of MCP server support, MCP client configuration, or third-party tool registration via MCP standard.

    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
    • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
    • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
    • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
    Musenone0/10

    No evidence Muse supports plugging in external MCP servers; it only describes its agent building its own tools internally, which is a different mechanism.

    • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
    • [claimed-docs] Muse has its own computer, with a file system and a terminal, so it can write its own code and build the tools a task needs.
  2. ai-native userUse an official CLI

    weight 2 · round to Gemini

    Community discussion confirms the existence of an official 'Gemini CLI' used for software development (comm-13, comm-14), but there is no first-party documentation of it in the evidence pack, and a hands-on report shows it fails to work for Workspace accounts ('Failed to login... now as a Workspace account I cant use Gemini CLI for my work') (comm-15). Missing for 10: official CLI documentation/spec, installation and usage guides, and evidence that login/account restrictions have been resolved.

    • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
    • [community] I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…
    • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
    Musenone0/10

    No evidence of an official CLI for Muse; all evidence describes a consumer app/avatar/chat interface with an internal terminal for the agent itself, not a CLI for AI-native users to interact with Muse.

    • ai-native userDrive the product through a documented public API

      weight 3 · round to Gemini

      Community evidence confirms a public Gemini API exists and is actively used by developers (pricing tiers, model versions, Google AI Studio parameters like temperature and top_k), but the evidence pack contains no first-party API reference documentation, and one community report notes undocumented/hidden parameter behavior (fixed top_k, capped temperature) that limits full programmatic control. missing for 10: first-party API reference/docs citation, SDK/auth documentation, confirmation that documented parameters match actual behavior.

      • [community] API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …
      • [community] I'm sure this is a very impressive model, but gemini-3-pro-preview is failing spectacularly at my fairly basic python benchmark. In fact, ge…
      • [community] My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…
      • [community] Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …
      • [community] It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…
      Musenone0/10

      No evidence of a documented public API for developers to programmatically drive Muse; all evidence describes end-user chat/app features and internal agent behavior, not an external API surface.

      • ai-native userBuild against official SDKs

        weight 2 · round drawn
        Gemininone0/10

        The evidence pack only covers Gemini's consumer-facing app features (uploads, Gemini Live, Gems, connected apps) and does not document any official SDKs for building applications (e.g., Python/Node/Go SDKs for the Gemini API). Community mentions reference API pricing and a 'Gemini CLI' having login issues, but no concrete SDK documentation or hands-on developer usage evidence is present.

        • [community] API pricing is up to $2/M for input and $12/M for output. For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output, Gemini …
        • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
        Musenone0/10

        No evidence of any official SDK for developers to build against; evidence only covers end-user features (avatars, goals, side chats, agent building its own tools) rather than a developer-facing SDK.

        • ai-native userSubscribe to events via webhooks

          weight 2 · round drawn
          Gemininone0/10

          No evidence in the pack describes Gemini offering a webhook subscription mechanism for events; the docs cover imports, connected apps, Gems, Live, Deep Research, etc., but nothing about outbound webhooks or event subscriptions for AI-native/agentic integration.

            Musenone0/10

            No evidence in the pack mentions webhooks or any event-subscription API for developers; Muse's documented features focus on agent tasks, permissions, and integrations, not outbound webhook subscriptions. missing for 10: any webhook/event API documentation, developer subscription mechanism, or third-party confirmation of webhook support.

            Agentic features

            1. ai-native userGet AI-generated insights and suggestions from my data inside the product

              weight 2 · round to Gemini

              Gemini's docs show robust support for generating insights from user data: uploading documents/spreadsheets/photos/videos for 'answers, summaries, and insights' (gemini-docs-25), Notebooks for organizing and querying sources (gemini-docs-11, gemini-docs-24, gemini-docs-29), Deep Research for in-depth analysis (gemini-docs-7), and Connected Apps that summarize Gmail and productivity data (gemini-docs-30). Independent hands-on reports corroborate real usage: navigating large codebases effortlessly (gemini-comm-13), replacing an OCR vendor for document ingestion with strong accuracy (gemini-comm-17), and NotebookLM being 'really powerful for comprehending large corpuses' (gemini-comm-19), though one report notes weaker accuracy on visual bounding-box tasks (gemini-comm-18). missing for 10: broader independent benchmarking specifically on insight-generation quality across data types, and resolution of the noted accuracy gaps in some visual tasks.

              • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
              • [claimed-docs] Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.
              • [claimed-docs] you can use notebooks to organize your projects in a dedicated, focused space.
              • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
              • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
              • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
              • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
              • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…
              • [community] Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…

              Muse links personal data sources (email, calendar, social, health, finances) and proactively tracks tasks/goals, implying some data-driven suggestions, but the evidence never explicitly describes AI-generated insights or recommendations derived from that data—most documentation focuses on agentic task execution and tool-building rather than analytic insight generation. missing for 10: explicit description of insight/recommendation generation from user data, independent hands-on validation of this specific capability.

              • [claimed-docs] Link your email, calendar, Instagram, Facebook, health and fitness data, and finances.
              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
              • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
            2. ai-native userSet up automations that run autonomously in the background

              weight 2 · round to Gemini
              Geminipartialclaimed6/10

              Google's docs explicitly describe scheduling recurring actions so Gemini becomes part of daily/weekly/monthly routines (gemini-docs-8), and the Daily Brief feature autonomously delivers a personalized digest without user prompting (gemini-docs-32/41), supported by action-taking integrations with other apps (gemini-docs-10/17/23/30). However, evidence is limited to first-party docs with no independent/hands-on confirmation of reliability, no detail on trigger conditions, failure handling, or scope of what 'recurring actions' can actually do autonomously. Missing for 10: independent verification that scheduled automations run reliably unattended, documentation on trigger/condition logic, and evidence of broader autonomous multi-step task execution beyond simple digests.

              • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…

              Muse's Goals tab, activity log, and approval-card workflow (muse-docs-5, muse-docs-8, muse-docs-13) show first-party support for autonomous background task tracking and execution, and muse-docs-7 explicitly describes agents building tools for unattended tasks. However, an independent hands-on stress test found the agent's control plane starts timing out under load, exposing concrete failure points in its background-automation architecture (muse-comm-1), directly undercutting reliability claims for autonomous operation. missing for 10: independent confirmation that background automations run reliably at scale, more detail on scheduling/triggering mechanisms for autonomous runs.

              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
              • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
              • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
              • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
              • [community] Blog post title/finding: the author stress-tested Meta Muse until its agent control plane started timing out, exposing failure points in the…
            3. ai-native userDelegate tasks to a built-in AI assistant inside the product

              weight 3 · round drawn

              Gemini's docs show extensive task delegation: connected apps to take actions in Gmail/Calendar/Maps/Flights (gemini-docs-10, gemini-docs-23, gemini-docs-30), scheduled recurring actions (gemini-docs-8), custom Gems for specific goals (gemini-docs-9), Deep Research for autonomous multi-step research (gemini-docs-7), and Daily Brief proactive digests (gemini-docs-32, gemini-docs-41). Community evidence corroborates real-world delegated use cases like large codebase analysis and audio transcription (gemini-comm-13, gemini-comm-10). missing for 10: independent hands-on verification specifically of agentic task delegation/action-taking (vs. just Q&A), and evidence of reliability/success rate when Gemini executes multi-step delegated tasks.

              • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
              • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
              • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
              • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
              • [community] My favorite benchmark is to analyze a very long audio file recording of a management meeting and produce very good notes along with a transc…

              Muse is explicitly a built-in AI agent with its own compute, terminal, and file system to build tools and complete delegated tasks (goals, side chats, autonomous tool creation), with approval flows and activity logs for oversight. Missing for 10: independent hands-on verification of delegation quality beyond stress-test edge cases and more detail on task breadth/reliability at scale.

              • [claimed-docs] Muse has its own computer, with a file system and a terminal, so it can write its own code and build the tools a task needs.
              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
              • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
              • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
              • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
            4. ai-native userOperate the product with natural-language commands

              weight 2 · round to Gemini
              Geminifullclaimed8/10

              Gemini is fundamentally operated via natural-language chat and voice (Gemini Live's free-flowing conversation, 'Hey Google' voice commands, text prompts for image generation, scheduling recurring actions, custom Gems, and connected-app actions) rather than rigid commands or GUIs, per extensive first-party docs. Missing for 10: independent/hands-on verification that complex natural-language action requests (e.g., connected-app task execution) reliably work as described, and community evidence is mixed on model quality/accuracy for specific tasks rather than confirming the NL interface itself.

              • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
              • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini.
              • [claimed-docs] With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.
              • [claimed-docs] you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
              • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
              • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
              • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen

              Muse is designed around a chat interface where users talk to it in natural language to manage goals, tasks, and tool-building ('talk to it about these tasks in chat', side chats for topic-specific NL interaction). This is corroborated by first-party docs describing conversational control as the primary interface. missing for 10: independent hands-on confirmation of broad natural-language command coverage beyond goals/chat, and detail on command reliability at scale (comm-1 notes control-plane timeouts under stress).

              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
              • [claimed-docs] some people still wanted separate context for certain topics — which made sense as projects grew more complex. So we built side chats.
              • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
              • [community] Blog post title/finding: the author stress-tested Meta Muse until its agent control plane started timing out, exposing failure points in the…

            Agents tasks — stories about agents tasks in this arenaAgents tasks

            Stories about agents tasks in this arena

            Agent mode

            1. power-userDelegate a multi-step task that the assistant works on autonomously in the background and returns for my review

              weight 3 · round to Gemini
              Geminipartialclaimed6/10

              Deep Research lets users delegate an open-ended research task that Gemini works on autonomously and returns a report for review, and scheduled/recurring actions show background task automation; Connected Apps/Gems add some autonomous action-taking on the user's behalf. However there's no clear evidence of a general-purpose multi-step 'agent mode' that plans and executes across arbitrary apps end-to-end with an explicit review/approval step, nor independent hands-on confirmation of this workflow. Missing for 10: evidence of a broad autonomous agent (beyond Deep Research/scheduling) handling arbitrary multi-step tasks across apps, and independent/community validation of such background task delegation working reliably.

              • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
              • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
              • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…

              Muse's docs describe autonomous background task handling via the Goals tab, self-built tools, activity logs and approval cards for review — matching the delegate-and-review story [muse-docs-5][muse-docs-7][muse-docs-8][muse-docs-13][muse-docs-10]. However, an independent hands-on stress test found the agent's control plane timing out under load, exposing failure points in the very autonomous-task architecture being claimed [muse-comm-1], and another commenter notes the assistant is less capable than power-user expectations for building/using tools [muse-comm-2]. Missing for 10: reproducible evidence of reliable long-running multi-step task completion, and resolution/acknowledgment of the reported control-plane timeout issue.

              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
              • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
              • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
              • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
              • [claimed-docs] structured approval cards with clear accept/reject actions, and secure storage for your credentials.
              • [community] Blog post title/finding: the author stress-tested Meta Muse until its agent control plane started timing out, exposing failure points in the…
              • [community] "I, too, have a personal agent but my friends using Muse or Instinct approach the functionality I use mine for quite easily... a sophisticat…
            2. power-userHave the assistant operate a web browser on my behalf to research and complete tasks on websites

              weight 3 · round to Gemini
              Geminipartialclaimed4/10

              Deep Research lets Gemini conduct 'in-depth and real-time research' across web sources, and Connected Apps let it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission — showing some research/task-automation capability. However, there is no evidence of Gemini actually driving a web browser (navigating pages, clicking, filling forms) to complete tasks on arbitrary websites, only sanctioned first-party app integrations. Missing for 10: explicit browser-control/agentic navigation evidence, hands-on demonstration of completing a multi-step website task, independent corroboration of this capability.

              • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
              • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
              • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
              • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
              • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
              Musenone0/10

              Evidence describes Muse having its own computer/terminal to build tools, task tracking (Goals tab), and permissions/approval cards, but nothing in the pack mentions browser automation or web navigation on the user's behalf. Missing for 10: any mention of browser control, web research execution, or site-task completion capability.

              • power-userLet the assistant see and operate applications on my computer to complete work

                weight 2 · round to Gemini
                Geminipartialclaimed5/10

                Gemini's Connected Apps feature lets it take actions in other apps (Gmail, Calendar, Maps, Flights) with permission, and on Android it can see what's on-screen to help with context, but this is limited to a curated set of app integrations/APIs rather than general computer-use/desktop automation across arbitrary applications. Missing for 10: broader OS-level screen perception, ability to click/type across arbitrary desktop apps, and independent hands-on evidence of an agentic computer-use mode.

                • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
                • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.

                Muse describes having its own computer/terminal to build tools and links external accounts (email, calendar, social, health, finance) via structured approvals, which lets it act on the user's behalf across services, but the evidence never shows it seeing or directly operating applications on the user's own device (e.g., screen/GUI control) — it operates its own sandboxed environment, not the user's computer. Missing for 10: evidence of direct screen/GUI control of the user's local applications, and independent confirmation that this cross-app automation reliably works beyond linked-account integrations.

                • [claimed-docs] Muse has its own computer, with a file system and a terminal, so it can write its own code and build the tools a task needs.
                • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
                • [claimed-docs] structured approval cards with clear accept/reject actions, and secure storage for your credentials.
                • [claimed-docs] Link your email, calendar, Instagram, Facebook, health and fitness data, and finances.

              Tasks

              1. power-userSchedule recurring or one-off tasks that run automatically and come back to me with results

                weight 2 · round to Gemini
                Geminipartialclaimed6/10

                Gemini docs confirm scheduling recurring actions (gemini-docs-8) and Daily Brief personalized digest (gemini-docs-32/41), showing one-off/recurring automated tasks that return results. However, evidence lacks detail on task complexity, multi-step agent tasks, notification delivery mechanisms, or independent/community corroboration of this specific feature working reliably. missing for 10: detailed documentation on scheduling flexibility, agentic multi-step task execution, notification/result delivery mechanisms, and independent hands-on validation of the scheduled-tasks feature.

                • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
                • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…

                Muse's Goals tab and activity log suggest it can track and manage ongoing tasks with an audit trail of completed/planned actions, implying some form of persistent task tracking, but there is no explicit documentation of recurring/scheduled triggers or a scheduling UI. Community evidence also shows the agent's control plane can time out under stress, raising doubts about reliability for automated recurring runs. missing for 10: explicit scheduling/recurrence configuration docs, evidence of one-off vs recurring task setup, and independent confirmation that scheduled tasks reliably complete and report back.

                • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
                • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
                • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
                • [community] Blog post title/finding: the author stress-tested Meta Muse until its agent control plane started timing out, exposing failure points in the…

              Apps devices — stories about apps devices in this arenaApps devices

              Stories about apps devices in this arena

              Apps

              1. power-userUse an official desktop app with OS-level shortcuts and access to what is on my screen

                weight 2 · round to Gemini
                Geminipartialclaimed5/10

                Docs confirm an official Mac desktop app with a global OS-level keyboard shortcut (Option+Space) to summon Gemini without opening a browser [gemini-docs-15, gemini-docs-36, gemini-docs-20], but the only 'see what's on your screen' capability documented is for the Android mobile app via 'Hey Google' [gemini-docs-6], not the desktop app. Missing for 10: evidence of desktop screen-reading/screenshare capability, and independent/hands-on confirmation of the desktop shortcut and screen access working together.

                • [claimed-docs] you can also use the keyboard shortcut Option + Space to bring up the Gemini chat window after the app is installed and running
                • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
                • [claimed-docs] What you need to use the Gemini app on Mac * A personal Google Account you manage on your own, or a work or school account that your adminis…
                • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
                Musenone0/10

                Evidence describes Muse as an AI agent with its own computer/file system, chat, and permission tracking, but there is no mention of an official desktop app, OS-level keyboard shortcuts, or screen access/observation capability. This appears to be a mobile/app-based assistant rather than a desktop tool with screen access.

                • knowledge-workerUse full-featured official mobile apps for iOS and Android

                  weight 2 · round to Gemini
                  Geminipartialclaimed6/10

                  Docs confirm a full-featured Gemini mobile app with rich functionality (Gemini Live voice conversations, screen-aware Android assistant via 'Hey Google', Maps/Flights integration, daily briefs, scheduling, image generation, coding help) showing strong Android support, and generic mobile-app language implies broader availability, but the evidence never explicitly names or details an iOS app or iOS-specific parity. missing for 10: explicit iOS app documentation/feature parity, App Store presence, and any cross-platform comparison confirming equal functionality on iOS vs Android.

                  • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
                  • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
                  • [claimed-docs] Make plans with Google Maps and Google Flights
                  • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
                  • [claimed-docs] get help with writing, brainstorming, coding, and more, without needing to open a web browser.
                  • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                  • [claimed-docs] If you have access to Gemini Apps with a work or school account, some Gemini mobile app features aren’t available.
                  • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…

                  There is clear evidence of an iOS app (App Store reviews cited via apps.apple.com), but no evidence at all of an Android app, and no detailed description of feature parity between platforms. missing for 10: Android app existence, feature-completeness claims for either platform, independent verification of app quality.

                  • [claimed-docs] I find it more pleasant than Gemini or ChatGPT which is my default for this type of work.
                  • [claimed-docs] I’d been curious to try OpenClaw, but didn’t want to deal with the security concerns or headache of setting it up.

                Custom bots

                1. power-userBuild and share custom assistants with their own instructions and knowledge

                  weight 2 · round to Gemini
                  Geminipartialclaimed6/10

                  Gemini's "Gems" feature (gemini-docs-9) lets power-users create a custom Gem with its own instructions and requirements, and Gems can be given knowledge via uploaded files/sources (gemini-docs-25), directly matching the core of this story. However, evidence does not confirm a straightforward sharing/publishing mechanism for Gems to other users, nor independent hands-on validation of the feature's robustness. Missing for 10: documentation of sharing/publishing custom Gems with other users, evidence of knowledge-base scope/limits, and independent community corroboration of Gems in practice.

                  • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                  • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                  Musenone0/10

                  Evidence shows Muse supports personal customization (avatar naming/style, side chats for separate contexts) but nothing about creating a distinct 'assistant' with its own instructions/knowledge base that can be shared with other users, which is the core of this story.

                  Automation depth — how much of the product can run unattendedAutomation depth

                  How much of the product can run unattended

                  1. ai-native userPerform bulk operations across many items at once

                    weight 2 · round to Gemini

                    Gemini supports uploading whole code folders/repos and large codebases (a form of bulk ingestion) and can take actions across connected apps or run scheduled recurring actions, but there is no explicit documentation of a bulk/batch operation feature (e.g., applying an action to many items at once like bulk-editing files, mass-tagging, or batch task execution) as an AI-native automation capability. missing for 10: explicit bulk-action/batch-processing feature, evidence of applying one instruction across many discrete items simultaneously, independent corroboration of this specific capability.

                    • [claimed-docs] To add a code folder: click More Uploads Import Code Upload folder.
                    • [claimed-docs] To add a code folder: click More Uploads ... Import Code ... Upload folder.
                    • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
                    • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                    • [community] I have been using this for about a month and it's a beast, mostly thanks to 2.5pro being SOTA and also how it leverages that huge 1M context…
                    Musenone0/10

                    No evidence describes Muse performing bulk operations across many items; docs mention goals tracking, avatars, side chats, and tool-building, but nothing about batch/bulk processing of items. The community stress-test post even highlights the agent timing out under load rather than handling bulk tasks smoothly.

                    • ai-native userDefine rules that trigger actions automatically on events

                      weight 3 · round to Gemini
                      Geminipartialclaimed4/10

                      Gemini supports 'scheduling recurring actions' as part of daily/weekly/monthly routines (gemini-docs-8), which is a form of automation, but this is time-based scheduling rather than user-defined conditional rules that trigger on arbitrary events. Connected Apps let Gemini take actions in other apps (gemini-docs-10, gemini-docs-23, gemini-docs-30) but only in response to a direct user request, not an automatic event trigger. Missing for 10: evidence of event-based (not just time-based) trigger conditions, ability to define custom 'if X happens then do Y' rules, and any confirmation of conditional logic beyond fixed recurring schedules.

                      • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
                      • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                      • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                      • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                      Musenone0/10

                      The evidence describes Muse's goal tracking, tool-building, and approval workflows, but there is no mention of user-defined conditional rules or event-triggered automations (e.g., 'when X happens, do Y'). Missing for 10: any documentation of a rules/trigger engine, event-based automation configuration, or examples of users setting conditional actions.

                      • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
                      • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
                    • ai-native userSchedule recurring jobs or workflows

                      weight 2 · round to Gemini
                      Geminipartialclaimed6/10

                      Gemini docs explicitly confirm scheduling recurring actions ('daily, weekly, and monthly routines') via a dedicated feature (gemini-docs-8), and Daily Brief shows an example of a recurring automated digest (gemini-docs-32/41). However, evidence lacks detail on workflow complexity, chaining multiple steps/tools, error handling, or independent/community validation of this scheduling feature. missing for 10: detail on multi-step workflow scheduling, chaining across apps, reliability/error handling, and independent hands-on confirmation.

                      • [claimed-docs] You can make Gemini a part of your daily, weekly, and monthly routines by scheduling recurring actions.
                      • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                      • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                      Musenone0/10

                      While Muse has a Goals tab that tracks ongoing tasks and an activity log, there is no evidence describing recurring/scheduled job execution, cron-like automation, or repeat-workflow triggers. missing for 10: explicit scheduling/recurrence feature, evidence of periodic execution, workflow automation configuration.

                      • ai-native userVersion, review, and roll back my automations

                        weight 1 · round to Muse
                        Gemininone0/10

                        No evidence of version control, review workflows, or rollback capabilities for automations (e.g., scheduled actions, Gems, or connected app actions). The evidence only covers scheduling recurring actions and connecting apps, with no mention of versioning, diffing, review approval, or rollback of automations.

                          Muse provides an activity log/audit trail and approval cards that support reviewing what the agent has done and plans to do (muse-docs-8, muse-docs-13, muse-docs-10), which covers the 'review' portion of the story. However, there is no evidence of explicit versioning of automations/skills or a rollback mechanism to revert an automation to a prior state — the 'Forget' skill only removes stored information, not automation history. missing for 10: explicit versioning of automations, a rollback/undo feature for agent actions, independent confirmation these review tools work reliably in practice.

                          • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
                          • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
                          • [claimed-docs] structured approval cards with clear accept/reject actions, and secure storage for your credentials.
                          • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.

                        Connectors apps — stories about connectors apps in this arenaConnectors apps

                        Stories about connectors apps in this arena

                        Connectors

                        1. power-userBrowse a directory of third-party apps and connectors and add them to the assistant

                          weight 2 · round to Gemini
                          Geminipartialclaimed6/10

                          Gemini docs describe a 'Connected Apps' feature that lets users link Gmail, Calendar, Maps, Flights and 'a variety of productivity apps' so Gemini can search/create content and take actions, which matches the connectors-directory concept ([gemini-docs-10],[gemini-docs-17],[gemini-docs-23],[gemini-docs-30],[gemini-docs-33],[gemini-docs-19]). However, the evidence never shows a browsable app-store-like directory UI, doesn't clarify how many third-party (non-Google) apps are included, and there's no independent/hands-on confirmation of the browse-and-add experience. Missing for 10: explicit directory/marketplace UI screenshots or docs, breadth of third-party (non-Google) app listings, independent user corroboration of adding connectors.

                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                          • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                          • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
                          • [claimed-docs] Make plans with Google Maps and Google Flights

                          Muse lets users link specific third-party data sources like email, calendar, Instagram, Facebook, health and finance data (muse-docs-11), which shows some connector-adding capability, but there is no evidence of a browsable directory or marketplace of third-party apps/connectors to explore and add. Missing for 10: an actual app/connector directory UI, discovery/browsing mechanism, and independent confirmation of a marketplace beyond ad-hoc account linking.

                          • [claimed-docs] Link your email, calendar, Instagram, Facebook, health and fitness data, and finances.
                        2. knowledge-workerConnect my cloud drive, email, and calendar so the assistant can search and use them in answers

                          weight 3 · round to Gemini
                          Geminifullclaimed8/10

                          Google's docs describe first-party 'Connected Apps' letting Gemini summarize Gmail, create Calendar events, search across productivity apps, and use personal Gmail/Drive as sources for Deep Research, directly matching the story's cloud drive/email/calendar connector requirement. Missing for 10: independent/hands-on verification of search quality and confirmation that calendar reading (not just event creation) works reliably.

                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                          • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                          • [claimed-docs] Boost productivity: Summarize emails from Gmail, create events in Google Calendar or third-party apps, or search for content across a variet…
                          • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.

                          Muse docs explicitly support linking email and calendar (and other data sources) with approval/permission controls, but no evidence mentions a cloud drive connector (e.g., Google Drive/Dropbox), and there's no hands-on confirmation that these connected sources are actually searched/used in answers beyond permission approval cards. missing for 10: explicit cloud drive integration, independent evidence of search/use in answers.

                          • [claimed-docs] Link your email, calendar, Instagram, Facebook, health and fitness data, and finances.
                          • [claimed-docs] structured approval cards with clear accept/reject actions, and secure storage for your credentials.
                          • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.

                        Files analysis — stories about files analysis in this arenaFiles analysis

                        Stories about files analysis in this arena

                        Analysis

                        1. power-userHave the assistant write and run code on my data to produce charts, computed answers, and downloadable files

                          weight 3 · round to Muse
                          Gemininone0/10

                          The evidence pack shows Gemini can import/upload code folders and GitHub repos and get 'insights' from uploaded documents/spreadsheets, but there is no evidence of an actual code-execution/sandbox feature that writes and runs code to produce charts, computed answers, or downloadable output files. No docs or community reports describe this specific data-analysis-with-code-execution workflow.

                          • [claimed-docs] To add a GitHub repository: More Uploads Import Code and enter the GitHub repository or branch URL.
                          • [claimed-docs] To add a code folder: click More Uploads Import Code Upload folder.
                          • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…

                          Muse's docs claim it 'has its own computer, with a file system and a terminal' and can 'write its own code and build the tools a task needs,' which supports general code-execution capability, but there's no explicit mention of producing charts, computed answers, or downloadable files for user data analysis. A community stress-test report also notes the agent's control plane can time out under load, raising doubts about reliability for heavier computational tasks. Missing for 10: explicit documentation or examples of chart generation, data analysis outputs, downloadable file creation, and independent verification of successful code-execution results.

                          • [claimed-docs] Muse has its own computer, with a file system and a terminal, so it can write its own code and build the tools a task needs.
                          • [claimed-docs] If a task needs a tool that doesn't exist, your agent builds it for you.
                          • [community] Blog post title/finding: the author stress-tested Meta Muse until its agent control plane started timing out, exposing failure points in the…

                        Artifacts

                        1. knowledge-workerHave the assistant create and iteratively edit documents, presentations, and other files I can export

                          weight 2 · round to Gemini
                          Geminipartialclaimed4/10

                          Evidence documents Gemini's ability to generate and iteratively edit images (Nano Banana) with export/download at set resolutions, and general writing assistance, but there is no evidence of a dedicated document or presentation creation/editing workflow (e.g., a canvas-style doc/slide editor) with export to file formats. Missing for 10: explicit documentation of creating/iterating on text documents or slide decks, and exporting them to standard file formats (docx/pptx/pdf).

                          • [claimed-docs] You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …
                          • [claimed-docs] Local edits: Making quick and specific changes to parts of an image.
                          • [claimed-docs] Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…
                          • [claimed-docs] Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.
                          • [claimed-docs] Blend text, images, and video to bring your ideas to life.
                          • [claimed-docs] The Gemini app provides quick access to AI features, allowing you to get help with writing, brainstorming, coding, and more, without needing…
                          Musenone0/10

                          Muse's evidence focuses on its file system/terminal, tool-building, goals, avatars, and privacy controls, but nothing describes creating or iteratively editing documents, presentations, or exportable files for knowledge-work tasks. missing for 10: any mention of document/presentation creation, editing UI, or export functionality.

                          Files

                          1. knowledge-workerUpload documents, spreadsheets, and PDFs and get accurate analysis of their contents

                            weight 3 · round to Gemini

                            First-party docs explicitly state users can upload documents, spreadsheets, and more to get answers, summaries, and insights (gemini-docs-25), and independent hands-on evidence corroborates accurate document/PDF analysis (a fintech user reporting 96% OCR accuracy on PDFs, comm-17) plus praise for NotebookLM's ability to comprehend large source corpora (comm-19). Missing for 10: dedicated evidence on spreadsheet-specific accuracy and broader independent benchmarking across document types beyond the single fintech PDF case.

                            • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                            • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
                            • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…
                            Musenone0/10

                            No evidence in the pack describes Muse handling document/spreadsheet/PDF uploads or analyzing their contents; the material focuses on agent features like avatars, goals, side chats, permissions, and tool-building, not file ingestion or analysis accuracy.

                            Memory context — stories about memory context in this arenaMemory context

                            Stories about memory context in this arena

                            Memory

                            1. power-userHave the assistant remember relevant context from previous chats and apply it in new conversations

                              weight 3 · round to Gemini
                              Geminifullclaimed8/10

                              Gemini docs explicitly describe a personalization feature where 'the memory of your past Gemini chats' informs new conversations, plus user controls to review/delete that activity, confirming both the capability and its persistence across sessions. Missing for 10: independent hands-on validation of cross-chat memory recall accuracy and more detail on scope/duration of retained context.

                              • [claimed-docs] You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats
                              • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.

                              Muse's docs imply persistent memory (a 'Forget skill' to remove remembered info about topics/people, plus 'side chats' for separate context threads and a Goals tab tracking ongoing tasks) suggesting it retains and reuses context across conversations, but there is no first-party or hands-on description of how memory is surfaced or applied in new chats. Missing for 10: explicit documentation of cross-chat memory recall/application, independent verification that remembered context actually surfaces in new conversations, and detail on memory scope/limits.

                              • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.
                              • [claimed-docs] some people still wanted separate context for certain topics — which made sense as projects grew more complex. So we built side chats.
                              • [claimed-docs] So we built side chats.
                              • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
                            2. power-userSet persistent custom instructions and preferences that shape every response

                              weight 1 · round to Gemini
                              Geminipartialclaimed5/10

                              Gemini offers a 'memory of past chats' personalization feature (gemini-docs-18) and custom Gems that let users pre-set instructions/goals (gemini-docs-9), which together approximate persistent customization, but there's no documented single 'custom instructions' setting that explicitly shapes every response across all chats. Missing for 10: explicit persistent instruction/preference settings applied globally to every response, independent verification of memory consistency, and detail on how memory interacts with different chat sessions.

                              • [claimed-docs] You can get a personalized experience in Gemini Apps based on: The memory of your past Gemini chats
                              • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                              • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                              Musenone0/10

                              No evidence describes a persistent custom-instructions or preference-setting feature that shapes all responses; docs mention forget skill, avatars, side chats, and permissions but nothing about setting standing instructions/preferences.

                              Projects

                              1. knowledge-workerOrganize related chats and files into a project or space that shares context and instructions

                                weight 2 · round to Gemini

                                Gemini's 'Notebooks' feature explicitly provides a continuous, focused space that remembers sources, instructions, and ongoing chat history, and lets users upload documents, code, and other files into that same organized context (gemini-docs-11, gemini-docs-24, gemini-docs-25, gemini-docs-29). Custom Gems (gemini-docs-9) further let users set persistent instructions for recurring tasks, and independent commentary confirms NotebookLM/Notebooks are genuinely useful for organizing large source sets into a coherent project workspace (gemini-comm-19), though that same source flags UI/display shortcomings. Missing for 10: no first-party doc detailing multi-chat organization within one persistent 'project' the way competitors define it, and no hands-on evidence of shared-instruction consistency across many chats in the same notebook.

                                • [claimed-docs] Notebooks provide a continuous chat experience that remembers your sources, instructions, and ongoing discussions.
                                • [claimed-docs] you can use notebooks to organize your projects in a dedicated, focused space.
                                • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                                • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                                • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                                • [community] I've been using NotebookLM powered by Gemini 2.0 for three projects and it is really powerful for comprehending large corpuses you can't pos…

                                Muse offers 'side chats' for separate context on topics as work grows complex and a Goals tab for tracking tasks, suggesting some contextual organization, but there is no explicit 'project/space' construct that bundles chats+files+shared instructions together. Missing for 10: explicit project/workspace container, file-attachment grouping, shared custom instructions across chats, and independent verification of how side chats share or isolate context.

                                • [claimed-docs] The Goals tab is where Muse keeps track of all this for you, and you can interact directly there or talk to it about these tasks in chat.
                                • [claimed-docs] some people still wanted separate context for certain topics — which made sense as projects grew more complex. So we built side chats.
                                • [claimed-docs] So we built side chats.

                              Multimodal — stories about multimodal in this arenaMultimodal

                              Stories about multimodal in this arena

                              Images

                              1. knowledge-workerGenerate and edit images from natural-language prompts

                                weight 2 · round to Gemini
                                Geminifullclaimed8/10

                                Gemini docs explicitly describe generating and editing images via natural-language prompts (Nano Banana 2), including local edits, character consistency, blending images, and resolution export options. missing for 10: independent hands-on corroboration of image editing quality and no community evidence testing this specific feature.

                                • [claimed-docs] You can create captivating images in seconds with Nano Banana 2. From work, play, or anything in between, Gemini Apps can help you generate …
                                • [claimed-docs] Local edits: Making quick and specific changes to parts of an image.
                                • [claimed-docs] Character consistency: Maintain the look of a person or character across various generated images, including the ability to combine multiple…
                                • [claimed-docs] You can create captivating images in seconds with Nano Banana 2.
                                • [claimed-docs] Download images at at 2K resolution with a Google AI plan or at 1K without an AI plan.
                                • [claimed-docs] Blend text, images, and video to bring your ideas to life.
                                Musenone0/10

                                The evidence pack contains no mention of image generation, editing, or any visual/multimodal content creation capability for Muse; it focuses on agent/task automation, avatars, chat organization, and privacy controls. missing for 10: any documentation of image generation from prompts, image editing tools, or multimodal output examples.

                                • knowledge-workerShare screenshots and photos and have the assistant accurately interpret what is in them

                                  weight 2 · round to Gemini

                                  Docs confirm users can upload photos/screenshots and get insights (gemini-docs-25) and get screen-context help via 'Hey Google' (gemini-docs-6), but hands-on reports show real accuracy failures: Gemini generated 'wildly inaccurate bounding boxes' on images (gemini-comm-18) and failed to correctly interpret a manipulated photo, missing key details even in the latest version (gemini-comm-12). A positive OCR use case exists (gemini-comm-17) but that's for PDFs, not general screenshot/photo scene interpretation, so the core 'accurately interpret' claim is contradicted by concrete hands-on failures. Missing for 10: independent benchmarks specifically on screenshot/UI interpretation accuracy, and resolution of the documented bounding-box/detail-recognition failures.

                                  • [claimed-docs] You can upload documents, spreadsheets, notebooks, photos, videos, and more to Gemini Apps to get answers, summaries, and insights about you…
                                  • [claimed-docs] On Android, say “Hey Google” to ask Gemini for help with what’s on your screen
                                  • [community] Unfortunately Gemini really seems to struggle on this, and no matter how we tried prompting it, it would generate wildly inaccurate bounding…
                                  • [community] It still failed my image identification test (a photoshopped picture of a dog with 5 legs)... Gemini 3 however, while still failing, at leas…
                                  • [community] I work in fintech and we replaced an OCR vendor with Gemini at work for ingesting some PDFs... Processing time went from something like 12 m…
                                  Musenone0/10

                                  No evidence in the pack discusses image, screenshot, or photo interpretation capabilities of Muse; all citations focus on agent architecture, avatars, goals, side chats, and privacy controls. Missing for 10: any mention of image/vision input support, screenshot sharing, or accuracy of visual interpretation.

                                  Voice

                                  1. knowledge-workerHave a natural, real-time voice conversation with the assistant

                                    weight 2 · round to Gemini
                                    Geminifullclaimed8/10

                                    Gemini Live is explicitly documented to support natural, free-flowing, interruptible voice conversations where Gemini talks back verbally in real time, directly matching the story. Missing for 10: independent/hands-on community corroboration specifically validating the voice conversation experience (community evidence covers other Gemini features/models but not Live voice interactions).

                                    • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
                                    • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini.
                                    • [claimed-docs] With Gemini Live, you can: * **Talk back and forth:** Talk to Gemini without typing, and Gemini will respond back verbally.
                                    • [claimed-docs] you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more details or change th…
                                    Musenone0/10

                                    No evidence describes real-time voice conversation capability for Muse; the evidence pack focuses on agent tool-building, goals, side chats, avatar, and privacy features, with no mention of voice interaction or speech interface. Missing for 10: any documentation of voice input/output, real-time conversational voice mode, or hands-on account of speaking with Muse.

                                    Openness — open source, data portability, and self-hosting storiesOpenness

                                    Open source, data portability, and self-hosting stories

                                    1. ai-native userDo everything through the API that I can do in the UI

                                      weight 2 · round drawn
                                      Gemininone0/10

                                      The evidence pack details many Gemini Apps UI-only features (Gems, Deep Research, Connected Apps, Daily Brief, Live conversations, Notebooks, scheduling) with no corresponding API documentation showing these are exposed programmatically. Community evidence (e.g., gemini-comm-11) even notes the API/AI Studio path is more restricted (capped temperature, hidden top_k) than the full product, reinforcing that API and UI capability sets are not equivalent.

                                      • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                                      • [claimed-docs] To create a custom Gem to meet your goals, provide info about your request and requirements.
                                      • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                                      • [claimed-docs] With Gemini Live, you can have a natural, free-flowing conversation with Gemini. You can even interrupt it like when you want to add more de…
                                      • [claimed-docs] Start your day with a personalized digest from Gemini. Your Daily Brief understands your rhythms and personal preferences to deliver your to…
                                      • [community] Temperature continues to be gated to maximum of 0.2, and there's still the hidden top_k of 64 that you can't turn off. I love the google AI …
                                      Musenone0/10

                                      No evidence pack mentions a public API for Muse at all; all evidence describes UI features (avatars, Goals tab, side chats, activity log) with no mention of programmatic access. Absence of evidence for an applicable capability is 'none'.

                                      • ai-native userExport all of my data in open formats and leave

                                        weight 3 · round drawn
                                        Gemininone0/10

                                        Evidence covers activity deletion/review (gemini-docs-31) but no mention of exporting data in open/portable formats or data-export tooling for leaving the platform. Missing for 10: any documentation of a data export/download feature (e.g., Google Takeout integration), open-format export options, or independent confirmation of data portability.

                                        • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                        Musenone0/10

                                        There is no evidence of a data export feature or open-format data portability in Muse; the pack only mentions a 'Forget' privacy skill and audit trail, not export/download of user data.

                                        Privacy posture — data-handling and privacy storiesPrivacy posture

                                        Data-handling and privacy stories

                                        1. ai-native userChoose where my data is stored (region/residency)

                                          weight 2 · round drawn
                                          Gemininone0/10

                                          The evidence pack covers Gemini's features and privacy/data-use settings (e.g., activity retention, human review opt-outs) but contains no mention of data residency or regional storage controls for AI-native/enterprise users. missing for 10: any documentation of region selection, data residency guarantees, or enterprise data-location controls.

                                            Musenone0/10

                                            No evidence in the pack mentions data residency, region selection, or storage location controls for Muse users.

                                            • ai-native userPrevent my data from being used to train AI models

                                              weight 3 · round to Gemini
                                              Geminipartialclaimed7/10

                                              Google's support docs state that chats and uploaded files in Gemini Apps are not reviewed by humans or used to improve generative AI models, and users can manage/delete their activity via 'My Activity' and toggle 'Keep Activity' off (gemini-docs-38, gemini-docs-31). However, a separate doc notes that audio/video from Gemini Live can be used to train models unless the user opts out, showing the training-data control is feature-specific rather than a single unified setting (gemini-docs-37). Missing for 10: a clear, centralized opt-out control covering all Gemini surfaces (not just chat text), independent/hands-on verification that opted-out data is truly excluded from training, and clarity for enterprise/Workspace accounts.

                                              • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                                              • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                                              • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                              Musenone0/10

                                              The evidence pack covers Muse's agent features, permissions, forget skill, and audit trail, but contains no mention of any opt-out or control over whether user data is used to train AI models. missing for 10: explicit opt-out/consent setting for model training, any privacy policy language addressing training-data usage.

                                              • ai-native userControl data retention and deletion

                                                weight 2 · round to Gemini
                                                Geminifullclaimed8/10

                                                Google's support docs explicitly describe controls to review prompts, delete Gemini Apps activity, and turn off 'Keep Activity' (gemini-docs-31), plus explicit statements that chats/files are not used for model training by default (gemini-docs-38) while audio/video in Gemini Live can be opted in/out of training use (gemini-docs-37) — directly matching retention/deletion control for an AI-native user. Missing for 10: independent/hands-on verification that deletion actually removes data, and detail on data export or full account-level deletion workflows.

                                                • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                                • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                                                • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.

                                                Muse offers a 'Forget' skill to remove information about specific topics/people and provides an activity log/audit trail of actions, giving users some visibility and control, but there's no documentation of full account/data deletion, export, or granular retention policy settings. Missing for 10: explicit data export/deletion controls, retention period settings, and independent verification that 'Forget' fully purges underlying data rather than just suppressing recall.

                                                • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.
                                                • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
                                                • [claimed-docs] Tapping on your Muse avatar will show you its full activity log as well as permissions you’ve approved.
                                              • ai-native userOpt out of telemetry and usage tracking

                                                weight 2 · round to Gemini
                                                Geminipartialclaimed6/10

                                                Docs show Gemini provides some privacy controls: reviewing/deleting prompts and turning off 'Keep Activity' (gemini-docs-31), and settings around whether audio/video/chats are used to improve models (gemini-docs-37, gemini-docs-38). This addresses usage-history and training-data opt-out but not a full 'telemetry/usage tracking' opt-out (e.g., diagnostic/product analytics separate from chat history) and there's no independent verification of these controls' effectiveness. Missing for 10: explicit documentation of a general telemetry/analytics opt-out toggle beyond activity/training-data settings, and independent/hands-on confirmation that opting out actually stops tracking.

                                                • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                                • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                                                • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                                                Musenone0/10

                                                No evidence pack items mention a telemetry/usage-tracking opt-out setting; there is a 'Forget skill' for topic memory and privacy page references, but nothing about disabling telemetry or usage analytics collection. Missing for 10: any documentation of a telemetry/analytics opt-out toggle, privacy policy language on usage data collection, or user reports confirming such a control exists.

                                                • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.
                                                • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.

                                              Research answers — stories about research answers in this arenaResearch answers

                                              Stories about research answers in this arena

                                              Research

                                              1. knowledge-workerLaunch a deep research run that autonomously searches many sources and returns a cited report

                                                weight 3 · round to Gemini
                                                Geminifullclaimed7/10

                                                Gemini Apps has a documented Deep Research feature that conducts in-depth, real-time research across sources and allows adding personal sources (Gmail, Drive, uploads, NotebookLM notebooks) for the research, matching the autonomous multi-source research story. missing for 10: explicit documentation of citation formatting in the final report and independent hands-on evidence of report quality/citation accuracy from third parties.

                                                • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                                                • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                                                Musenone0/10

                                                No evidence describes Muse performing a deep research run that autonomously searches multiple sources and returns a cited report; the pack focuses on avatar personalization, goals/side chats, permissions, and tool-building, none of which document a research/citation workflow. Missing for 10: any mention of multi-source search, report generation, or citation output.

                                                • knowledge-workerGet answers grounded in current web results with citations back to the sources

                                                  weight 2 · round to Gemini
                                                  Geminipartialclaimed6/10

                                                  Gemini's Deep Research feature explicitly supports 'in-depth and real-time research on almost any subject,' implying grounded, current-web-based answers, and users can add further sources for research context. However, the evidence pack never explicitly documents inline citation links back to specific web sources, nor independent confirmation that citations are reliably shown. Missing for 10: explicit documentation of citation/source-linking UI, independent verification that citations are accurate and consistently displayed.

                                                  • [claimed-docs] You can conduct in-depth and real-time research on almost any subject with Deep Research in Gemini Apps.
                                                  • [claimed-docs] You can change or add other sources, like your personal Gmail or Drive, for your research. You can also upload files and add NotebookLM note…
                                                  Musenone0/10

                                                  No evidence in the pack describes Muse performing web search with cited sources for research answers; the material focuses on agent architecture, avatars, permissions, and goals rather than grounded citation-backed answers.

                                                  Trust controls — stories about trust controls in this arenaTrust controls

                                                  Stories about trust controls in this arena

                                                  Data controls

                                                  1. knowledge-workerExport my complete chat history and account data

                                                    weight 1 · round drawn
                                                    Gemininone0/10

                                                    The evidence only covers reviewing and deleting Gemini activity via My Activity (gemini-docs-31) and privacy settings for Live audio (gemini-docs-37, gemini-docs-38), but there is no mention of exporting chat history or account data (e.g., via Google Takeout or a dedicated export tool). missing for 10: any documentation of an export/download feature for chat history or account data, independent confirmation of export completeness.

                                                    • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                                    Musenone0/10

                                                    Evidence shows a 'Forget' skill and audit trail/activity log, but there is no mention of a data export or account data download feature for chat history or account data. missing for 10: export/download tool for chat history, account data export functionality, documentation of data portability process.

                                                    • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.
                                                    • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.
                                                  2. knowledge-workerControl whether my conversations are used to train models

                                                    weight 3 · round to Gemini
                                                    Geminifullclaimed8/10

                                                    Google's own support docs state that by default chats/uploaded files aren't used to improve generative AI models unless a user opts in via 'Keep Activity', and that users can review, delete activity, or turn off Keep Activity at any time; separately, users must explicitly consent to let Google use Gemini Live audio/video for model training. This gives knowledge-workers clear, documented control over whether conversations feed model training. Missing for 10: independent/hands-on verification that these settings work as described and clarity on enterprise/Workspace account defaults.

                                                    • [claimed-docs] You can review your prompts, delete your Gemini Apps activity, and turn off Keep Activity in My Activity at any time.
                                                    • [claimed-docs] You can let Google use your audio and Gemini Live videos and screenshares to improve and develop its services, including training generative…
                                                    • [claimed-docs] Your chats and uploaded files in Gemini Apps won’t be reviewed by human reviewers or otherwise used to improve generative AI models.
                                                    Musenone0/10

                                                    The evidence pack shows privacy-adjacent features like a 'Forget skill' for memory and audit trails/permissions, but nothing addresses whether users can opt their conversations out of model training specifically. This is a fair axis for a personal AI agent product, but no evidence documents a training-data control. Missing for 10: any documentation of a training opt-out setting, data-usage policy toggle, or explicit statement about whether conversations are used for model training.

                                                    • [claimed-docs] You can also use the Forget skill to have Muse forget information about specific topics or people.
                                                    • [claimed-docs] Muse shows people a complete audit trail of everything it has done and plans to do.

                                                  Not comparable on these axes

                                                  1. ai-native userPoint an agent at llms.txt or agent-oriented docs

                                                    weight 2 · not comparable
                                                    Gemininone0/10

                                                    No evidence that Gemini can be pointed at llms.txt or agent-oriented documentation formats; the evidence only covers uploading files, GitHub repos, and connecting to apps, none of which address consuming llms.txt or agent-facing docs conventions. Missing for 10: any mention of llms.txt support, agent-oriented doc parsing, or a documented workflow for feeding agent-discovery docs to Gemini.

                                                      Musen/a

                                                      Muse is a consumer personal AI agent app, not a docs/API platform with an agent-facing surface; pointing an agent at llms.txt or agent-oriented docs is a wrong axis for this product category.

                                                      • ai-native userRun the product headlessly / in CI for automation

                                                        weight 2 · not comparable
                                                        Gemininone0/10

                                                        The evidence pack is dominated by consumer-facing Gemini Apps documentation (chat, image generation, Gemini Live, notebooks) and contains no first-party documentation of a headless mode, CI integration, or automation-friendly API/CLI usage. The only hint of a CLI tool appears in community complaints (gemini-comm-14, gemini-comm-15) about login failures for Workspace accounts trying to use 'Gemini CLI' for software development, which does not establish that headless/CI automation works.

                                                        • [community] I love how fragmented Google's Gemini offerings are. I'm a Pro subscriber, but I now learn I should be a 'Gemini Code Assist Standard or Ent…
                                                        • [community] 'Failed to login. Ensure your Google account is not a Workspace account.' ... now as a Workspace account I cant use Gemini CLI for my work, …
                                                        Musen/a

                                                        Muse is a consumer personal-AI-agent app (mobile/avatar-based, personal tasks, permissions), not a developer tool or framework meant to be invoked headlessly in CI pipelines; no evidence pack content relates to CLI, API, or automation-pipeline usage.

                                                        • ai-native userConnect an agent via an official MCP server

                                                          weight 3 · not comparable
                                                          Geminin/a

                                                          Gemini is itself an AI assistant/agent product; the evidence shows only that it can connect outward to other apps (Connected Apps, code import) as a client, not that it exposes an official MCP server for other agents to connect to it. Per the agent-role exception, this axis does not apply unless Gemini documents running as an MCP server, which no evidence here shows.

                                                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses. With your permission, Gemini can also he…
                                                          • [claimed-docs] Gemini Apps can connect to other apps to complete your request and give you more helpful responses.
                                                          • [claimed-docs] With your permission, Gemini can also help you take actions, like editing and managing your content in other apps.
                                                          • [claimed-docs] Get started with Connected Apps in Gemini **Important:** For now, Gemini can’t use Connected Apps in Gemini in Google Messages.
                                                          Musen/a

                                                          Muse is itself an AI agent product (consumer personal agent), not a service/platform exposing an MCP server for other agents to connect to; this axis is a category error for its role, akin to the agent-vs-server distinction.

                                                          • ai-native userIssue scoped/least-privilege API credentials for an agent

                                                            weight 2 · not comparable
                                                            Geminin/a

                                                            Gemini is an AI product/app, not a platform issuing API credentials with scoped permissions for agents; the evidence pack covers consumer features (imports, images, connected apps) with no mention of credential scoping or API key/permission management for agents, so this axis is a category error for this product's evidenced role.

                                                              Musenone0/10

                                                              Evidence shows Muse has approval cards, activity logs, and permission tracking for connected accounts, but nothing about issuing scoped or least-privilege API credentials/tokens for an agent to use with external services — this is a consumer personal-agent product, not a developer credential-management tool.

                                                              • ai-native userExplore an interactive API reference with runnable examples

                                                                weight 2 · not comparable
                                                                Geminin/a

                                                                This story asks for an interactive API reference with runnable examples, which is a developer-portal/API-docs concern, not a fair axis for Gemini Apps (the consumer product surfaced in this evidence pack). The evidence pack covers Gemini's app features (Gems, Connected Apps, Deep Research, Live) but contains no mention of an interactive API reference, making this a wrong-axis question for the product as evidenced.

                                                                  Musen/a

                                                                  Muse is a personal AI agent consumer product, not a developer API/SDK platform; the evidence pack shows no API reference or developer documentation concept at all, making this axis a category mismatch rather than a gap in an applicable capability.

                                                                  • ai-native userDownload a machine-readable API spec (OpenAPI or equivalent)

                                                                    weight 2 · not comparable
                                                                    Geminin/a

                                                                    Gemini here refers to the consumer AI assistant app/product; the story asks for a downloadable machine-readable API spec (OpenAPI), which is a developer-platform artifact, not a consumer app feature. This axis applies to API/platform products, not to the Gemini Apps experience described in the evidence.

                                                                      Musenone0/10

                                                                      No evidence Muse publishes any machine-readable API spec (OpenAPI or equivalent) for developers; all evidence concerns end-user agent features, not a documented API surface.

                                                                      • ai-native userTest against a sandbox environment without touching production data

                                                                        weight 1 · not comparable
                                                                        Geminin/a

                                                                        Gemini is a consumer/enterprise assistant product, not a dev platform with sandbox/production data environments; the evidence pack shows no sandbox testing environment concept, making this axis a category error for this product type.

                                                                          Musen/a

                                                                          Muse is a consumer personal AI agent (linking real email, calendar, social accounts) rather than a developer/testing product with sandbox vs production environments; the story's axis of testing against a sandbox without touching production data is a category error for this kind of product.

                                                                          • ai-native userRely on versioned APIs with a documented deprecation policy

                                                                            weight 2 · not comparable
                                                                            Gemininone0/10

                                                                            The evidence pack is entirely consumer-focused Gemini Apps documentation (image generation, Gemini Live, connected apps, notebooks) and general community sentiment about model quality/pricing; there is no mention of API versioning, version lifecycle, or a documented deprecation policy anywhere in the pack.

                                                                              Musen/a

                                                                              Muse is a consumer personal AI agent product, not a developer platform exposing versioned APIs; the story concerns API versioning/deprecation policy, which is a wrong axis for this end-user app.

                                                                              • ai-native userRead the product's source under an open license

                                                                                weight 2 · not comparable
                                                                                Geminin/a

                                                                                Gemini is a closed, proprietary AI product; no evidence suggests its source code is available under an open license, and open-sourcing the model itself is not a plausible axis for this kind of commercial closed product.

                                                                                  Musenone0/10

                                                                                  No evidence indicates Muse's source code is published under any open license; all evidence describes product features and community discussion, not source availability.

                                                                                  • ai-native userSelf-host the core product

                                                                                    weight 3 · not comparable
                                                                                    Geminin/a

                                                                                    Gemini is a closed, proprietary hosted AI service with no evidence of any self-hostable model weights or on-prem deployment option; self-hosting is not a plausible axis for this cloud-only consumer/enterprise product category.

                                                                                      Musenone0/10

                                                                                      No evidence anywhere in the pack indicates Muse can be self-hosted; it's described as a cloud/app-based agent product with no mention of open-source release or self-hosting options.

                                                                                      • team-adminManage members, permissions, and data policies for my organization's workspace

                                                                                        weight 2 · not comparable
                                                                                        Gemininone0/10

                                                                                        Evidence only shows end-user features (image generation, Live conversations, notebooks, connected apps) and passing mentions that a 'work or school account' administrator can 'enable Gemini,' but there is no evidence of an admin console for managing members, setting permissions, or configuring org-wide data policies.

                                                                                          Musen/a

                                                                                          Muse is a personal consumer AI agent for individuals, not a team/organization workspace product; there is no evidence of team-admin roles, member management, or org-wide permission/data policy controls. This is a category mismatch rather than a missing feature.