How Mailchimp’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score14/100
Agent-ready 23.8 × 0.30 = 7.14
API quality 0.0 × 0.20 = 0.00
Openness 8.7 × 0.20 = 1.74
Built-in AI 16.7 × 0.15 = 2.50
Automation 16.5 × 0.15 = 2.48
(7.14 + 0.00 + 1.74 + 2.50 + 2.48) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 13.86 ÷ 1.00 = 13.9
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready23.8/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 7 (quality) × 1.0 (full) = 14.0 of 20 max
- [probe] https://mailchimp.com/llms.txt“PROBE llms.txt: HTTP 200 at https://mailchimp.com/llms.txt # Mailchimp - Complete Web Content Analysis > Comprehensive analysis and documentation of web content ## Executive Sum”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 4 (quality) × 0.6 (partial) = 4.8 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Send a new SMS message through Mandrill”
- [community] https://news.ycombinator.com/item?id=18715866“A similar thing happened to me while using their Mandrill system. After years of using it with no issues, all of a sudden no emails were getting out, shut down without notice and without recourse.”
- [community] https://news.ycombinator.com/item?id=18715866“Someone sent a marketing email another customer complained about (just one complaint) and Mailchimp silently shut off our incoming email processed via Mandrill, without telling us.”
- [community] https://news.ycombinator.com/item?id=35235732“MailChimp blacklists your IP if you open the browser's dev tools; as a developer who often has devtools open, I get banned from Mailchimp for the day when helping with an automation.”
- [community] https://news.ycombinator.com/item?id=35235732“I had to use their drag-and-drop email builder because a non-dev would edit it; when a Code module became inaccessible via UI, I tried injecting br tags via the Inspector and got blocked/banned.”
Plug MCP servers into this product so it can use their toolsweight 3
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Connect an agent via an official MCP serverweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Use an official CLIweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Open Commerce (formerly Reaction Commerce) is an open source, API-first, modular commerce stack made for technical, growth-minded retailers.”
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Send a new SMS message through Mandrill”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Add a new route to an inbound domain or SMS program. Provide either domain or phone (not both).”
Issue scoped/least-privilege API credentials for an agentweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Send a new SMS message through Mandrill”
Build against official SDKsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Send a new SMS message through Mandrill”
Subscribe to events via webhooksweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Agent-ready = 42.8 ÷ 180 × 100 = 23.8
API quality0.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Send a new SMS message through Mandrill”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Requests an additional dedicated IP for your account. Accounts may have one outstanding request at any time, and provisioning requests are processed within 24 hours.”
- [claimed-docs] https://mailchimp.com/developer/transactional/api/“Add a new route to an inbound domain or SMS program. Provide either domain or phone (not both).”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [probe] https://mailchimp.com/llms.txt“PROBE llms.txt: HTTP 200 at https://mailchimp.com/llms.txt # Mailchimp - Complete Web Content Analysis > Comprehensive analysis and documentation of web content ## Executive Sum”
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [community] https://news.ycombinator.com/item?id=18715866“A similar thing happened to me while using their Mandrill system. After years of using it with no issues, all of a sudden no emails were getting out, shut down without notice and without recourse.”
- [community] https://news.ycombinator.com/item?id=18715866“Someone sent a marketing email another customer complained about (just one complaint) and Mailchimp silently shut off our incoming email processed via Mandrill, without telling us.”
API quality = 0.0 ÷ 70 × 100 = 0.0
Openness8.7/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [community] https://news.ycombinator.com/item?id=35235732“I had to use their drag-and-drop email builder because a non-dev would edit it; when a Code module became inaccessible via UI, I tried injecting br tags via the Inspector and got blocked/banned.”
Export all of my data in open formats and leaveweight 3
3 (weight) × 3 (quality) × 0.3 (disputed) = 2.7 of 30 max
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [community] https://news.ycombinator.com/item?id=18715866“MailChimp deleted my account with no warning after a period of inactivity, giving no notice, and support offered no path to recover the mailing list, only suggesting creation of a new account.”
- [community] https://news.ycombinator.com/item?id=18715866“I had a mailing list with them removed with all contacts lost and account banned without notification. Support falsely claimed data was wiped and only sent a data dump after I hinted at public shaming.”
- [community] https://news.ycombinator.com/item?id=18715866“MailChimp removed half my users from a mailing list claiming lots of unverified sign-ups and spam complaints, even though the sign-ups were all through MailChimp itself.”
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Open Commerce (formerly Reaction Commerce) is an open source, API-first, modular commerce stack made for technical, growth-minded retailers.”
Self-host the core productweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Open Commerce (formerly Reaction Commerce) is an open source, API-first, modular commerce stack made for technical, growth-minded retailers.”
Openness = 8.7 ÷ 100 × 100 = 8.7
Built-in AI16.7/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 5 (quality) × 0.6 (partial) = 6.0 of 20 max
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Multivariate and A/B Testing”
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Predictive Segmentation”
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Generative AI features”
- [claimed-docs] https://mailchimp.com“Actionable insights into audience growth and conversion funnels”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 3 (quality) × 0.6 (partial) = 5.4 of 30 max
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Generative AI features”
Operate the product with natural-language commandsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Generative AI features”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
Built-in AI = 15.0 ÷ 90 × 100 = 16.7
Automation16.5/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 4 (quality) × 0.3 (disputed) = 2.4 of 20 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Create a new omni-channel contact for an audience.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [community] https://news.ycombinator.com/item?id=18715866“They banned me after migrating an email list over because they said I couldn't confirm how I got the emails, even though they were legitimate newsletter sign-ups from my website.”
- [community] https://news.ycombinator.com/item?id=18715866“MailChimp removed half my users from a mailing list claiming lots of unverified sign-ups and spam complaints, even though the sign-ups were all through MailChimp itself.”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 4 (quality) × 0.6 (partial) = 7.2 of 30 max
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp Transactional (formerly Mandrill) sends targeted and event-driven messages via the API or SMTP, fast—with best-in-class deliverability.”
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
Schedule recurring jobs or workflowsweight 2
2 (weight) × 3 (quality) × 0.6 (partial) = 3.6 of 20 max
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/developer/“Mailchimp’s Marketing API powers timely, relevant marketing campaigns with custom data pulled directly from your app.”
Version, review, and roll back my automationsweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://mailchimp.com/developer/marketing/api/“Send a Mailchimp campaign. For RSS Campaigns, the campaign will send according to its schedule. All other campaigns will send immediately.”
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Multivariate and A/B Testing”
- [claimed-docs] https://mailchimp.com/pricing/marketing/“Predictive Segmentation”
Automation = 13.2 ÷ 80 × 100 = 16.5