Skip to content

Rank #8 of 8 in Agent Sandboxes & Code Execution

Modal Sandboxes logo

Modal Sandboxes

Modal Labs, Inc. · commercial

514132/yr +2pypi/wk -1.3M

Showcase

Modal Sandboxes homepage screenshot
homepage · captured Sep 2026 · view live ↗
Modal Sandboxes docs screenshot
docs · captured Sep 2026 · view live ↗

Try itExperimental

See what an agent can do with Modal Sandboxes before you ever sign up. Pick a story: recorded sessions replay real probe-harness transcripts; sandboxed self-drive sessions are designed and gated (docs/TRY-IT.md).

$modal --helprecorded session — replayed, not live
recorded 2026-09-04 · exit 0 · captured verbatim by our probe harness, secrets redacted

Verified integrations

Connections to other tracked products — hover a chip for the verbatim evidence quote behind it.

By theme — the product's score on each story themeBy theme

Agenticness — how well agents can access and operate the productAgenticnessevidence →

How well agents can access and operate the product

31.9/100

Automation depth — how much of the product can run unattendedAutomation depthevidence →

How much of the product can run unattended

9.0/100

Capabilities hardware — stories about capabilities hardware in this arenaCapabilities hardwareevidence →

Stories about capabilities hardware in this arena

26.7/100

Code execution — stories about code execution in this arenaCode executionevidence →

Stories about code execution in this arena

73.8/100

Dev experience — day-to-day developer experience — setup friction, docs, debugging, iteration speedDev experienceevidence →

Day-to-day developer experience — setup friction, docs, debugging, iteration speed

80.0/100

Isolation security — stories about isolation security in this arenaIsolation securityevidence →

Stories about isolation security in this arena

30.0/100

Openness — open source, data portability, and self-hosting storiesOpennessevidence →

Open source, data portability, and self-hosting stories

7.2/100

Performance scale — stories about performance scale in this arenaPerformance scaleevidence →

Stories about performance scale in this arena

27.7/100

Pricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limitsevidence →

Free-tier ceilings, usage caps, and rate limits before you have to pay

60.0/100

Privacy posture — data-handling and privacy storiesPrivacy postureevidence →

Data-handling and privacy stories

0.0/100

Provisioning lifecycle — creating, updating, and tearing down resources across their lifecycleProvisioning lifecycleevidence →

Creating, updating, and tearing down resources across their lifecycle

39.4/100

Snapshot persistence — stories about snapshot persistence in this arenaSnapshot persistenceevidence →

Stories about snapshot persistence in this arena

27.6/100

Story verdicts — every judged story with its evidenceStory verdicts

What’s free: 0 free · 4 paid · 0 enterprise · 23 not stated in evidence

?

Sorted by importance (agentic first) (high → low) · 51/51 stories · click a row’s chevron for the rationale and evidence

Drive the product through a documented public API G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness3full8/10T

Connect an agent via an official MCP server G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness3noneuntestednone yet

Delegate tasks to a built-in AI assistant inside the product G

Agentic features

ai-native userAgenticness — how well agents can access and operate the productAgenticness3n/auntestednone yet

Plug MCP servers into this product so it can use their tools G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness3noneuntestednone yet

Build against official SDKs G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2full8/10X

Point an agent at llms.txt or agent-oriented docs G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2full8/10T

Run the product headlessly / in CI for automation G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2full8/10T

Use an official CLI G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2full8/10T

Set up automations that run autonomously in the background G

Agentic features

ai-native userAgenticness — how well agents can access and operate the productAgenticness2partial6/10X

Download a machine-readable API spec (OpenAPI or equivalent) G

Api quality

ai-native userAgenticness — how well agents can access and operate the productAgenticness2none0/10

Explore an interactive API reference with runnable examples G

Api quality

ai-native userAgenticness — how well agents can access and operate the productAgenticness2none0/10

Issue scoped/least-privilege API credentials for an agent G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2none0/10

Operate the product with natural-language commands G

Agentic features

ai-native userAgenticness — how well agents can access and operate the productAgenticness2none0/10

Rely on versioned APIs with a documented deprecation policy G

Api quality

ai-native userAgenticness — how well agents can access and operate the productAgenticness2none0/10

Get AI-generated insights and suggestions from my data inside the product G

Agentic features

ai-native userAgenticness — how well agents can access and operate the productAgenticness2n/auntestednone yet

Subscribe to events via webhooks G

Agent access

ai-native userAgenticness — how well agents can access and operate the productAgenticness2noneuntestednone yet

Test against a sandbox environment without touching production data G

Api quality

ai-native userAgenticness — how well agents can access and operate the productAgenticness1full7/10T

Execute untrusted, AI-generated code without risking my own infrastructure C

Untrusted code

developerCode execution — stories about code execution in this arenaCode execution3full8/10T

My agent can provision its own sandbox, execute code, read the results, and tear it down — end to end without a human C

Agent lifecycle

ai-native userDev experience — day-to-day developer experience — setup friction, docs, debugging, iteration speedDev experience3full8/10T

Pay per second only for the compute a sandbox actually uses G

Pricing

platform-engineerPricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limits3fullpaid8/10X

Spin up an isolated sandbox with one API/SDK call and get a live environment in seconds C

Lifecycle

developerProvisioning lifecycle — creating, updating, and tearing down resources across their lifecycleProvisioning lifecycle3full8/10T

Rely on a documented hard isolation boundary (microVM or equivalent) between sandboxes and my systems C

Isolation

platform-engineerIsolation security — stories about isolation security in this arenaIsolation security3partial5/10T

Restrict or allow the sandbox's network egress with explicit policy C

Network policy

platform-engineerIsolation security — stories about isolation security in this arenaIsolation security3partial5/10T

Run large concurrent fleets of sandboxes with documented concurrency limits C

Scale

platform-engineerPerformance scale — stories about performance scale in this arenaPerformance scale3partialpaid5/10X

Snapshot a sandbox and later restore or fork new sandboxes from that snapshot C

Snapshots

developerSnapshot persistence — stories about snapshot persistence in this arenaSnapshot persistence3partial5/10C

Start sandboxes with documented sub-second-to-few-second cold starts C

Latency

developerPerformance scale — stories about performance scale in this arenaPerformance scale3partial4/10C

Define rules that trigger actions automatically on events G

ai-native userAutomation depth — how much of the product can run unattendedAutomation depth3noneuntestednone yet

Export all of my data in open formats and leave G

ai-native userOpenness — open source, data portability, and self-hosting storiesOpenness3noneuntestednone yet

Prevent my data from being used to train AI models G

ai-native userPrivacy posture — data-handling and privacy storiesPrivacy posture3n/auntestednone yet

Self-host the core product G

ai-native userOpenness — open source, data portability, and self-hosting storiesOpenness3noneuntestednone yet

Run arbitrary shell commands and install packages inside the sandbox C

Untrusted code

developerCode execution — stories about code execution in this arenaCode execution2full9/10T

Attach GPUs to sandboxed workloads C

Workloads

developerCapabilities hardware — stories about capabilities hardware in this arenaCapabilities hardware2fullpaid8/10X

Define custom sandbox templates or bring my own container image C

Runtimes

developerCode execution — stories about code execution in this arenaCode execution2full8/10X

Read, write, upload, and download files in the sandbox filesystem via the SDK C

Files

developerCode execution — stories about code execution in this arenaCode execution2full8/10T

Do everything through the API that I can do in the UI G

ai-native userOpenness — open source, data portability, and self-hosting storiesOpenness2partial6/10T

Execute code in multiple language runtimes (Python, JavaScript, and more) and get rich results back C

Runtimes

developerCode execution — stories about code execution in this arenaCode execution2partial6/10C

Perform bulk operations across many items at once G

ai-native userAutomation depth — how much of the product can run unattendedAutomation depth2partialpaid6/10X

Give an agent a sandbox where host secrets and credentials are unreachable by the code it runs C

Isolation

ai-native userIsolation security — stories about isolation security in this arenaIsolation security2partial5/10T

Keep a sandbox session running for hours or days for long agent tasks C

Scale

developerPerformance scale — stories about performance scale in this arenaPerformance scale2partial5/10X

Pause a running sandbox and resume it later with filesystem and memory state intact C

Snapshots

developerSnapshot persistence — stories about snapshot persistence in this arenaSnapshot persistence2partial4/10C

Expose a port from the sandbox on a public preview URL to reach services running inside C

Preview access

developerProvisioning lifecycle — creating, updating, and tearing down resources across their lifecycleProvisioning lifecycle2partial3/10T

Read the product's source under an open license G

ai-native userOpenness — open source, data portability, and self-hosting storiesOpenness2none0/10

Schedule recurring jobs or workflows G

ai-native userAutomation depth — how much of the product can run unattendedAutomation depth2none0/10

Choose where my data is stored (region/residency) G

ai-native userPrivacy posture — data-handling and privacy storiesPrivacy posture2noneuntestednone yet

Control data retention and deletion G

ai-native userPrivacy posture — data-handling and privacy storiesPrivacy posture2noneuntestednone yet

Opt out of telemetry and usage tracking G

ai-native userPrivacy posture — data-handling and privacy storiesPrivacy posture2noneuntestednone yet

Run a headless browser or full desktop environment inside the sandbox C

Workloads

developerCapabilities hardware — stories about capabilities hardware in this arenaCapabilities hardware2noneuntestednone yet

Run coding agents like Claude Code or Codex inside the sandbox following the vendor's own recipe C

Agent workloads

ai-native userCapabilities hardware — stories about capabilities hardware in this arenaCapabilities hardware2noneuntestednone yet

Set timeouts so sandboxes shut down automatically and stop billing when idle or done G

Lifecycle

developerProvisioning lifecycle — creating, updating, and tearing down resources across their lifecycleProvisioning lifecycle2noneuntestednone yet

Start building with a free tier or included credits without talking to sales G

Pricing

developerPricing limits — free-tier ceilings, usage caps, and rate limits before you have to payPricing limits1noneuntestednone yet

Version, review, and roll back my automations G

ai-native userAutomation depth — how much of the product can run unattendedAutomation depth1noneuntestednone yet

Opportunities — the stories that would move this product's scores, from its own judged verdictsOpportunitiestop 8 of 34 stories with headroom

What would move Modal Sandboxes’s scores — derived from its own judged verdicts, biggest headroom first. Each line quotes what the judge found missing; shipping it (or evidencing it publicly) is the fix.

  1. Agenticness — how well agents can access and operate the productPlug MCP servers into this product so it can use their tools

    nonemoves agent-readyimpact 45

    The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".

  2. Agenticness — how well agents can access and operate the productConnect an agent via an official MCP server

    nonemoves agent-readyimpact 45

    The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".

  3. Automation depth — how much of the product can run unattendedDefine rules that trigger actions automatically on events

    nonemoves PA Scoreimpact 30

    The evidence describes Modal Sandboxes as a programmatic, on-demand execution environment for untrusted/agent code, but nothing in the pack shows a rules/trigger engine that fires actions automatically on external events (e.g., webhooks, event-driven policies).

  4. Openness — open source, data portability, and self-hosting storiesExport all of my data in open formats and leave

    nonemoves PA Scoreimpact 30

    The axis applies to this product kind (peer products hold positive or none verdicts on this story), so lack of evidence for an applicable capability is "none", never "na".

  5. Openness — open source, data portability, and self-hosting storiesSelf-host the core product

    nonemoves PA Scoreimpact 30

    Modal is a fully-managed cloud platform for running Sandboxes; there is no evidence of any self-hostable/on-prem version of the core product, and everything described (pay-per-second billing, GPU access, hosted CLI) implies a proprietary SaaS deployment model only.

  6. Agenticness — how well agents can access and operate the productOperate the product with natural-language commands

    nonemoves Built-in AIimpact 30

    Modal Sandboxes is controlled exclusively via SDK (Python/JS/Go) calls and a traditional CLI (modal run, modal shell, etc.); there is no evidence of a natural-language command interface or chat-driven control layer for operating sandboxes.

  7. Agenticness — how well agents can access and operate the productIssue scoped/least-privilege API credentials for an agent

    nonemoves agent-readyimpact 30

    Missing: any documented API/credential-scoping mechanism, permission granularity docs, or examples of issuing least-privilege tokens to agents.

  8. Agenticness — how well agents can access and operate the productSubscribe to events via webhooks

    nonemoves agent-readyimpact 30

    No evidence anywhere in the pack of a webhook subscription mechanism or event-driven notification system for Modal Sandboxes; the docs focus on programmatic spin-up, execution, logging, and filesystem access, not outbound event/webhook subscriptions.

Showing the top 8 of 34 — every none/partial verdict in the story verdicts table is headroom.

Think a verdict is wrong? Every verdicts-table row has a Flag link — see the methodology.

Coverage map — which docs area, API section, or community source covers which judged storiesCoverage map7 surfaces · 27 covered stories

Where the cited evidence behind each covered verdict came from — the same citations the verdicts table shows, no extra judging.

docs24 stories

Probe proofs — replayable recordings from the probe harnessProbe proofs

Replayable recordings from our probe harness — see the Prove-It protocol to submit one.

$modal --helpreproduced
$ modal --help
 Usage: modal [OPTIONS] COMMAND [ARGS]...

 Modal is the fastest way to run code in the cloud.

 See the website at https://modal.com/ for documentation and more information
 about running code on Modal.

 Commands                                                                      
  curl         Send an authenticated request to a Modal endpoint.              
  deploy       Deploy a Modal application.                                     
  serve        Expose Web Functions with hot-reloading on code changes.        
  shell        Run a command or interactive shell inside a Modal container.    
  run          Run a Modal function or local entrypoint.                       

 Deployments                                                                   
  app          Manage deployed and running apps.                               
  container    Manage and connect to running containers.                       
  endpoint     Create and manage LLM inference endpoints.                      

 Storage                                                                       
  image        Manage Images.                                                  
  dict         Manage `modal.Dict` objects and inspect their contents.         
  secret       Manage secrets.                                                 
  queue        Manage `modal.Queue` objects and inspect their contents.        
  volume       Read and edit `modal.Volume` volumes.                           

 Onboarding                                                                    
  setup        Bootstrap Modal's configuration.                                
  bootstrap    Initialize a sample Modal App.                                  

 Configuration                                                                 
  workspace    Interact with the current Modal Workspace.                      
  environment  Create and interact with Environments                           
  profile      Switch between Modal profiles.                                  
  config       Manage client configuration for the current profile.            
  [redacted]        Manage [redacted]s.                                                  
  skills       Install and update Modal's agent skills.                        

 Observability                                                                 
  billing      View workspace billing information.                             
  changelog    Fetch release notes from the Modal changelog.                   
  dashboard    Open the Modal Dashboard in a web browser.                      
$modal --versionreproduced
$ modal --version
modal client version: 1.5.5
proves: Use an official CLIrecorded 2026-09-04

Claims vs evidence — vendor claims reconciled against independent verdictsClaims vs evidence

13 of 15 testable claims verified · 0 contradictedintegrity 87/100

15 distinct capability claims found in Modal Sandboxes’s own claimed-docs/GitHub materials, reconciled against our judge’s independent verdicts.

13

Verified

2

Unverified

0

Contradicted

12

Undersold

Verified (15)
Unverified (2)
Undersold (12)
Claims outside our story set (2)

Real capability claims found in Modal Sandboxes’s own materials, but no story in this arena’s taxonomy covers them yet — that’s feedback on the taxonomy, not a mark against the product.

  • Provides integrated logging and full visibility into every function, sandbox, and container

    source ↗
  • Alpha support for running sidecar containers alongside the main sandbox process

    source ↗
Suggest a story for these →

Business model

free-tiercreditsusage-basedsubscription-flatenterprise-custom

Per-second usage pricing for CPU, memory, and GPU with free monthly starter credits; the Team plan adds a flat monthly fee on top of usage, enterprise is custom.

pricing ↗

Score trend

How this product’s scores have moved as evidence and verdicts are re-derived — a point per change, not per day.

PA Score20 (Sep 4 '26)20 (Sep 16 '26)
Agent-ready40 (Sep 4 '26)42 (Sep 16 '26)

Try Experimental

Run it in the microterminal →

Recorded agent sessions — and a live MCP handshake where the vendor ships one.

Flag

⚑ Flag a verdict

Think a verdict is wrong? Opens a prefilled GitHub issue — or use the ⚑ next to any verdict above.

Badge

Embed this product's score badge →

Hotlinked SVG — always shows the live current score.

For agents

Data

Agent surface uptime llms.txt 100% (30d, checked every 6h since Sep 8 '26)