How LM Studio’s scores are calculated
The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.
verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10
PA Score27/100
Agent-ready 56.1 × 0.30 = 16.83
API quality 0.0 × 0.20 = 0.00
Openness 31.2 × 0.20 = 6.24
Built-in AI 28.0 × 0.15 = 4.20
Automation 0.0 × 0.15 = 0.00
(16.83 + 0.00 + 6.24 + 4.20 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 27.27 ÷ 1.00 = 27.3
Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.
Agent-ready56.1/100×0.30 of the PA blend
Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.
Point an agent at llms.txt or agent-oriented docsweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [probe] https://lmstudio.ai/llms.txt“PROBE llms.txt: HTTP 200 at https://lmstudio.ai/llms.txt # app # About LM Studio > Learn how to run Llama, DeepSeek, Phi, and other LLMs locally with LM Studio. LM Studio is”
- [probe] https://lmstudio.ai/docs/app.md“PROBE docs-md: HTTP 200 at https://lmstudio.ai/docs/app.md Explore the docs [#explore-the-docs] <Cards> <Card title="Bionic" description="Learn how to use LM Studio Bionic." hr”
Run the product headlessly / in CI for automationweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
- [community] https://news.ycombinator.com/item?id=44379792“I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.”
Plug MCP servers into this product so it can use their toolsweight 3
3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max
- [claimed-docs] https://lmstudio.ai/docs/app“Connect MCP servers and use them with local models”
- [community] https://news.ycombinator.com/item?id=44379792“The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.”
Connect an agent via an official MCP serverweight 3
n/a — not applicable to this product: excluded from numerator and denominator
- [claimed-docs] https://lmstudio.ai/docs/app“Connect MCP servers and use them with local models”
Use an official CLIweight 2
2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
- [claimed-docs] https://lmstudio.ai/docs/cli“get Search and download models”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms load openai/gpt-oss-20b --identifier="my-model-name"”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
Drive the product through a documented public APIweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://lmstudio.ai/docs/app“Serve local models on OpenAI-like endpoints, locally and on the network”
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
- [community] https://news.ycombinator.com/item?id=41323042“I LOVE LM studio, it's super convenient for testing model capabilities, and the OpenAI server makes it really easy to spin up a server and test. My typical process is to load it up in LM studio, test it, then move to vllm.”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
Issue scoped/least-privilege API credentials for an agentweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Build against official SDKsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
Subscribe to events via webhooksweight 2
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Connect a coding agent to this product as a working backendweight 3
3 (weight) × 7 (quality) × 0.6 (partial) = 12.6 of 30 max
- [claimed-docs] https://lmstudio.ai/docs/app“Serve local models on OpenAI-like endpoints, locally and on the network”
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
- [community] https://news.ycombinator.com/item?id=44379792“I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.”
- [community] https://news.ycombinator.com/item?id=44379792“I've been wanting to try LM Studio but I can't figure out how to use it over local network. My desktop in the living room has the beefy GPU, but I want to use LM Studio from my laptop in bed.”
- [community] https://news.ycombinator.com/item?id=41323042“I LOVE LM studio, it's super convenient for testing model capabilities, and the OpenAI server makes it really easy to spin up a server and test. My typical process is to load it up in LM studio, test it, then move to vllm.”
Agent-ready = 95.4 ÷ 170 × 100 = 56.1
API quality0.0/100×0.20 of the PA blend
The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.
Explore an interactive API reference with runnable examplesweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
Download a machine-readable API spec (OpenAPI or equivalent)weight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Test against a sandbox environment without touching production dataweight 1
1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max
- [claimed-docs] https://lmstudio.ai/docs/app“Connect MCP servers and use them with local models”
- [claimed-docs] https://lmstudio.ai“Work with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.”
- [claimed-docs] https://lmstudio.ai“Download the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.”
Rely on versioned APIs with a documented deprecation policyweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
API quality = 0.0 ÷ 70 × 100 = 0.0
Openness31.2/100×0.20 of the PA blend
Can you leave, inspect, or self-host — data export, open source, portability.
Do everything through the API that I can do in the UIweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms load openai/gpt-oss-20b --identifier="my-model-name"”
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [community] https://news.ycombinator.com/item?id=44379792“I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
Export all of my data in open formats and leaveweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
- [claimed-docs] https://lmstudio.ai/docs/app“Manage your local models, prompts, and configurations”
- [community] https://news.ycombinator.com/item?id=38377072“I really like LM Studio... A local model runtime, a model catalog, a UI to chat with models easily, an OpenAI compatible API, and plugins like RAG (ChromaDB). It's still unfortunate that it is not itself open-source.”
- [community] https://news.ycombinator.com/item?id=48939662“A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.”
Read the product's source under an open licenseweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [community] https://news.ycombinator.com/item?id=38377072“I really like LM Studio... A local model runtime, a model catalog, a UI to chat with models easily, an OpenAI compatible API, and plugins like RAG (ChromaDB). It's still unfortunate that it is not itself open-source.”
- [community] https://news.ycombinator.com/item?id=41323042“Nice, it's a solid product! It's just a shame it's not open source and its license doesn't permit work use.”
- [community] https://news.ycombinator.com/item?id=44379792“I really like LM Studio but their license / terms of use are very hostile. You're in breach if you use it for anything work related - so just be careful folks!”
- [community] https://news.ycombinator.com/item?id=48939662“A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.”
Self-host the core productweight 3
3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max
- [claimed-docs] https://lmstudio.ai/docs/app“Serve local models on OpenAI-like endpoints, locally and on the network”
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
- [community] https://news.ycombinator.com/item?id=44379792“I've been wanting to try LM Studio but I can't figure out how to use it over local network. My desktop in the living room has the beefy GPU, but I want to use LM Studio from my laptop in bed.”
- [community] https://news.ycombinator.com/item?id=44379792“I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.”
Openness = 31.2 ÷ 100 × 100 = 31.2
Built-in AI28.0/100×0.15 of the PA blend
Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.
Get AI-generated insights and suggestions from my data inside the productweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“You can attach documents to your chat messages and interact with them entirely offline, also known as "RAG".”
- [claimed-docs] https://lmstudio.ai“Work with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.”
- [claimed-docs] https://lmstudio.ai“Download the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.”
- [community] https://news.ycombinator.com/item?id=44379792“The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.”
- [community] https://news.ycombinator.com/item?id=48939662“I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.”
Set up automations that run autonomously in the backgroundweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“llmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.”
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [community] https://news.ycombinator.com/item?id=44379792“I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.”
- [community] https://news.ycombinator.com/item?id=47651540“Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.”
Delegate tasks to a built-in AI assistant inside the productweight 3
3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max
- [claimed-docs] https://lmstudio.ai“Work with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.”
- [claimed-docs] https://lmstudio.ai“Talk to Bionic naturally, and your speech gets transcribed in real time.”
- [claimed-docs] https://lmstudio.ai“Download the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.”
- [claimed-docs] https://lmstudio.ai“For your most demanding tasks, run Bionic with the latest frontier open models such as GLM 5.2, Kimi K3, and DeepSeek V4 Pro.”
- [community] https://news.ycombinator.com/item?id=48939662“I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.”
- [community] https://news.ycombinator.com/item?id=48939662“A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.”
Operate the product with natural-language commandsweight 2
2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“Use a simple and flexible chat interface”
- [claimed-docs] https://lmstudio.ai“Work with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.”
- [claimed-docs] https://lmstudio.ai“Talk to Bionic naturally, and your speech gets transcribed in real time.”
- [claimed-docs] https://lmstudio.ai“Download the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.”
- [community] https://news.ycombinator.com/item?id=44379792“The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.”
- [community] https://news.ycombinator.com/item?id=48939662“I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.”
Built-in AI = 25.2 ÷ 90 × 100 = 28.0
Automation0.0/100×0.15 of the PA blend
Depth of automation primitives — rules, scheduling, bulk operations, webhooks.
Perform bulk operations across many items at onceweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
- [claimed-docs] https://lmstudio.ai/docs/app“LM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.”
- [claimed-docs] https://lmstudio.ai/docs/cli“chat Start an interactive chat with a model”
- [claimed-docs] https://lmstudio.ai/docs/cli“get Search and download models”
- [claimed-docs] https://lmstudio.ai/docs/cli“lms server start lms server stop”
Define rules that trigger actions automatically on eventsweight 3
3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Schedule recurring jobs or workflowsweight 2
2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Version, review, and roll back my automationsweight 1
n/a — not applicable to this product: excluded from numerator and denominator
no evidence cited — the verdict rests on absence of evidence, re-checked on refresh
Automation = 0.0 ÷ 70 × 100 = 0.0