How FutureHouse Platform’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score19/100
Agent-ready 31.2 × 0.30 = 9.36
API quality 0.0 × 0.20 = 0.00
Openness 8.6 × 0.20 = 1.72
Built-in AI 51.6 × 0.15 = 7.74
Automation 0.0 × 0.15 = 0.00
(9.36 + 0.00 + 1.72 + 7.74 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 18.82 ÷ 1.00 = 18.8
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready31.2/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [probe] https://futurehouse.gitbook.io/llms.txt“PROBE llms.txt: HTTP 200 at https://futurehouse.gitbook.io/llms.txt # Edison Scientific Documentation ## Home - [Overview](https://docs.edisonscientific.com/overview.md) - [Agents](https”
- [probe] https://futurehouse.gitbook.io/futurehouse-cookbook.md“PROBE docs-md: HTTP 200 at https://futurehouse.gitbook.io/futurehouse-cookbook.md # Page Not Found The URL `futurehouse-cookbook` does not exist. This page may have been moved, renamed, or deleted. ##”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Authentication is done by providing an API key, which can be obtained directly from your profile page in the Edison platform”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
Plug MCP servers into this product so it can use their toolsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Connect an agent via an official MCP serverweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Use an official CLIweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
Drive the product through a documented public APIweight 3
3 (weight) × 7 (quality) × 1.0 (full) = 21.0 of 30 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Authentication is done by providing an API key, which can be obtained directly from your profile page in the Edison platform”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Under "API Tokens", click "Create New Token."”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Authentication is done by providing an API key, which can be obtained directly from your profile page in the Edison platform”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Under "API Tokens", click "Create New Token."”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Under "API Tokens," click "Create New Token."”
Build against official SDKsweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Authentication is done by providing an API key, which can be obtained directly from your profile page in the Edison platform”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“Under "API Tokens", click "Create New Token."”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
- [probe] https://futurehouse.gitbook.io/futurehouse-cookbook.md“PROBE docs-md: HTTP 200 at https://futurehouse.gitbook.io/futurehouse-cookbook.md # Page Not Found The URL `futurehouse-cookbook` does not exist. This page may have been moved, renamed, or deleted. ##”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Agent-ready = 56.2 ÷ 180 × 100 = 31.2
API quality0.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
- [probe] https://futurehouse.gitbook.io/futurehouse-cookbook.md“PROBE docs-md: HTTP 200 at https://futurehouse.gitbook.io/futurehouse-cookbook.md # Page Not Found The URL `futurehouse-cookbook` does not exist. This page may have been moved, renamed, or deleted. ##”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“uv pip install edison-client”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Test against a sandbox environment without touching production dataweight 1
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
API quality = 0.0 ÷ 60 × 100 = 0.0
Openness8.6/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Precedent determines whether a research idea has been tried before. It searches across fields to assess novelty and identify gaps”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Molecules is a chemistry-focused agent for molecular design and analysis.”
- [probe] https://futurehouse.gitbook.io/openapi.json“PROBE openapi: all candidate paths 404 (https://futurehouse.gitbook.io/openapi.json, https://futurehouse.gitbook.io/swagger.json, https://futurehouse.gitbook.io/api/openapi.json, https://futurehouse.gitbook.io/.well-known/openapi.json)”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Self-host the core productweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Openness = 6.0 ÷ 70 × 100 = 8.6
Built-in AI51.6/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Given a research objective and one or more datasets, Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“You can ask it a complex scientific question and get a high-accuracy, cited response, or task it with a deep literature review synthesizing conflicting evidence across hundreds of papers.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“It turns raw data into detailed analyses, statistical results, and publication-ready figures.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Precedent determines whether a research idea has been tried before. It searches across fields to assess novelty and identify gaps”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Every conclusion is fully auditable. You can trace any finding back to the specific code or literature passage that produced it.”
- [probe] https://futurehouse.gitbook.io/futurehouse-cookbook.md“PROBE docs-md: HTTP 200 at https://futurehouse.gitbook.io/futurehouse-cookbook.md # Page Not Found The URL `futurehouse-cookbook` does not exist. This page may have been moved, renamed, or deleted. ##”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“You can ask it a complex scientific question and get a high-accuracy, cited response, or task it with a deep literature review synthesizing conflicting evidence across hundreds of papers.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Precedent determines whether a research idea has been tried before. It searches across fields to assess novelty and identify gaps”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Molecules is a chemistry-focused agent for molecular design and analysis.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Given a research objective and one or more datasets, Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
Operate the product with natural-language commandsweight 2
2 (weight) × 7 (quality) × 0.6 (partial) = 8.4 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“You can ask it a complex scientific question and get a high-accuracy, cited response, or task it with a deep literature review synthesizing conflicting evidence across hundreds of papers.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“Given a research objective and one or more datasets, Kosmos autonomously reads literature, writes and executes analysis code, generates hypotheses, and produces a comprehensive cited report.”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook“task it with a deep literature review synthesizing conflicting evidence across hundreds of papers”
Built-in AI = 46.4 ÷ 90 × 100 = 51.6
Automation0.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
Define rules that trigger actions automatically on eventsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Schedule recurring jobs or workflowsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_data = { "name": JobNames.LITERATURE, "query": "Which neglected diseases had a treatment developed by artificial intelligence?", }”
- [claimed-docs] https://futurehouse.gitbook.io/futurehouse-cookbook/futurehouse-client/quickstart“task_response = client.run_tasks_until_done(task_data)”
Version, review, and roll back my automationsweight 1
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Automation = 0.0 ÷ 40 × 100 = 0.0