Skip to content

How LM Studio’s scores are calculated

The full audit trail, recomputed from the verdict data at build time through the same code that produced the leaderboard: verdict × quality × story weight per cell, cells sum to dimension scores, dimensions blend into the PA Score. Every number on the product page is reproducible from this page alone; for why the formula looks like this, see the methodology.

verdict factors: full ×1.0 · partial ×0.6 · disputed ×0.3 · none ×0.0 · n/a excluded from both sides · cell points = weight × quality × factor · cell max = weight × 10

PA Score27/100

Agent-ready 56.1 × 0.30 = 16.83

API quality 0.0 × 0.20 = 0.00

Openness 31.2 × 0.20 = 6.24

Built-in AI 28.0 × 0.15 = 4.20

Automation 0.0 × 0.15 = 0.00

(16.83 + 0.00 + 6.24 + 4.20 + 0.00) ÷ (0.30 + 0.20 + 0.20 + 0.15 + 0.15) = 27.27 ÷ 1.00 = 27.3

Scores are stored to 1 decimal; the product page’s pills round to whole numbers for display. Each dimension below shows the stories, verdicts, and cited evidence behind its number.

Agent-ready56.1/100×0.30 of the PA blend

Outside-in: can YOUR agent reach and drive this product — API, MCP, CLI, headless runs, agent docs.

Point an agent at llms.txt or agent-oriented docsweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [probe] https://lmstudio.ai/llms.txtPROBE llms.txt: HTTP 200 at https://lmstudio.ai/llms.txt # app # About LM Studio > Learn how to run Llama, DeepSeek, Phi, and other LLMs locally with LM Studio. LM Studio is
  • [probe] https://lmstudio.ai/docs/app.mdPROBE docs-md: HTTP 200 at https://lmstudio.ai/docs/app.md Explore the docs [#explore-the-docs] <Cards> <Card title="Bionic" description="Learn how to use LM Studio Bionic." hr

Run the product headlessly / in CI for automationweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop
  • [claimed-docs] https://lmstudio.ai/docs/clilms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.
  • [community] https://news.ycombinator.com/item?id=44379792I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.

Plug MCP servers into this product so it can use their toolsweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://lmstudio.ai/docs/appConnect MCP servers and use them with local models
  • [community] https://news.ycombinator.com/item?id=44379792The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.

Connect an agent via an official MCP serverweight 3

n/a — not applicable to this product: excluded from numerator and denominator

  • [claimed-docs] https://lmstudio.ai/docs/appConnect MCP servers and use them with local models

Use an official CLIweight 2

2 (weight) × 8 (quality) × 1.0 (full) = 16.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model
  • [claimed-docs] https://lmstudio.ai/docs/cliget Search and download models
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop
  • [claimed-docs] https://lmstudio.ai/docs/clilms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]
  • [claimed-docs] https://lmstudio.ai/docs/clilms load openai/gpt-oss-20b --identifier="my-model-name"
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.

Drive the product through a documented public APIweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://lmstudio.ai/docs/appServe local models on OpenAI-like endpoints, locally and on the network
  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop
  • [community] https://news.ycombinator.com/item?id=41323042I LOVE LM studio, it's super convenient for testing model capabilities, and the OpenAI server makes it really easy to spin up a server and test. My typical process is to load it up in LM studio, test it, then move to vllm.
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.

Issue scoped/least-privilege API credentials for an agentweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Build against official SDKsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop

Subscribe to events via webhooksweight 2

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Connect a coding agent to this product as a working backendweight 3

3 (weight) × 7 (quality) × 0.6 (partial) = 12.6 of 30 max

  • [claimed-docs] https://lmstudio.ai/docs/appServe local models on OpenAI-like endpoints, locally and on the network
  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.
  • [community] https://news.ycombinator.com/item?id=44379792I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.
  • [community] https://news.ycombinator.com/item?id=44379792I've been wanting to try LM Studio but I can't figure out how to use it over local network. My desktop in the living room has the beefy GPU, but I want to use LM Studio from my laptop in bed.
  • [community] https://news.ycombinator.com/item?id=41323042I LOVE LM studio, it's super convenient for testing model capabilities, and the OpenAI server makes it really easy to spin up a server and test. My typical process is to load it up in LM studio, test it, then move to vllm.

Agent-ready = 95.4 ÷ 170 × 100 = 56.1

API quality0.0/100×0.20 of the PA blend

The programmable surface once an agent is there — machine-readable spec, interactive docs, sandbox, versioning discipline.

Explore an interactive API reference with runnable examplesweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model

Download a machine-readable API spec (OpenAPI or equivalent)weight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Test against a sandbox environment without touching production dataweight 1

1 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 10 max

  • [claimed-docs] https://lmstudio.ai/docs/appConnect MCP servers and use them with local models
  • [claimed-docs] https://lmstudio.aiWork with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.
  • [claimed-docs] https://lmstudio.aiDownload the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.

Rely on versioned APIs with a documented deprecation policyweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop

API quality = 0.0 ÷ 70 × 100 = 0.0

Openness31.2/100×0.20 of the PA blend

Can you leave, inspect, or self-host — data export, open source, portability.

Do everything through the API that I can do in the UIweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop
  • [claimed-docs] https://lmstudio.ai/docs/clilms load [--gpu=max|auto|0.0-1.0] [--context-length=1-N]
  • [claimed-docs] https://lmstudio.ai/docs/clilms load openai/gpt-oss-20b --identifier="my-model-name"
  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [community] https://news.ycombinator.com/item?id=44379792I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.

Export all of my data in open formats and leaveweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

  • [claimed-docs] https://lmstudio.ai/docs/appManage your local models, prompts, and configurations
  • [community] https://news.ycombinator.com/item?id=38377072I really like LM Studio... A local model runtime, a model catalog, a UI to chat with models easily, an OpenAI compatible API, and plugins like RAG (ChromaDB). It's still unfortunate that it is not itself open-source.
  • [community] https://news.ycombinator.com/item?id=48939662A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.

Read the product's source under an open licenseweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [community] https://news.ycombinator.com/item?id=38377072I really like LM Studio... A local model runtime, a model catalog, a UI to chat with models easily, an OpenAI compatible API, and plugins like RAG (ChromaDB). It's still unfortunate that it is not itself open-source.
  • [community] https://news.ycombinator.com/item?id=41323042Nice, it's a solid product! It's just a shame it's not open source and its license doesn't permit work use.
  • [community] https://news.ycombinator.com/item?id=44379792I really like LM Studio but their license / terms of use are very hostile. You're in breach if you use it for anything work related - so just be careful folks!
  • [community] https://news.ycombinator.com/item?id=48939662A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.

Self-host the core productweight 3

3 (weight) × 8 (quality) × 1.0 (full) = 24.0 of 30 max

  • [claimed-docs] https://lmstudio.ai/docs/appServe local models on OpenAI-like endpoints, locally and on the network
  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.
  • [community] https://news.ycombinator.com/item?id=44379792I've been wanting to try LM Studio but I can't figure out how to use it over local network. My desktop in the living room has the beefy GPU, but I want to use LM Studio from my laptop in bed.
  • [community] https://news.ycombinator.com/item?id=44379792I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.

Openness = 31.2 ÷ 100 × 100 = 31.2

Built-in AI28.0/100×0.15 of the PA blend

Inside-out: how agentic the product itself is for its users — built-in assistants, autonomous features.

Get AI-generated insights and suggestions from my data inside the productweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appYou can attach documents to your chat messages and interact with them entirely offline, also known as "RAG".
  • [claimed-docs] https://lmstudio.aiWork with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.
  • [claimed-docs] https://lmstudio.aiDownload the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.
  • [community] https://news.ycombinator.com/item?id=44379792The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.
  • [community] https://news.ycombinator.com/item?id=48939662I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.

Set up automations that run autonomously in the backgroundweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appllmster is the headless version of LM Studio, no desktop app required. It's ideal for servers, CI environments, or any machine where you don't need a GUI.
  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [community] https://news.ycombinator.com/item?id=44379792I wish LM Studio had a pure daemon mode... you have to have the whole big chonky Electron UI running. Its UI is powerful but a lot less nice than e.g. BoltAI for casual use.
  • [community] https://news.ycombinator.com/item?id=47651540Local models are finally starting to feel pleasant instead of just 'possible.' The headless LM Studio flow is especially nice because it makes local inference usable from real tools instead of as a demo.

Delegate tasks to a built-in AI assistant inside the productweight 3

3 (weight) × 6 (quality) × 0.6 (partial) = 10.8 of 30 max

  • [claimed-docs] https://lmstudio.aiWork with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.
  • [claimed-docs] https://lmstudio.aiTalk to Bionic naturally, and your speech gets transcribed in real time.
  • [claimed-docs] https://lmstudio.aiDownload the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.
  • [claimed-docs] https://lmstudio.aiFor your most demanding tasks, run Bionic with the latest frontier open models such as GLM 5.2, Kimi K3, and DeepSeek V4 Pro.
  • [community] https://news.ycombinator.com/item?id=48939662I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.
  • [community] https://news.ycombinator.com/item?id=48939662A friendly reminder that both LM Studio app and now this new LM Studio Bionic app are closed source. Since most people are unaware of this fact.

Operate the product with natural-language commandsweight 2

2 (weight) × 6 (quality) × 0.6 (partial) = 7.2 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appUse a simple and flexible chat interface
  • [claimed-docs] https://lmstudio.aiWork with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely.
  • [claimed-docs] https://lmstudio.aiTalk to Bionic naturally, and your speech gets transcribed in real time.
  • [claimed-docs] https://lmstudio.aiDownload the latest local LLMs directly within the app and use them for simple chats or advanced agentic tasks.
  • [community] https://news.ycombinator.com/item?id=44379792The initial experience with LMStudio and MCP doesn't seem great... asked it to read the top headline from HN and it got stuck on an infinite loop... figuring out how to download new models isn't obvious either.
  • [community] https://news.ycombinator.com/item?id=48939662I have never previously tried an agentic harness for local models, but I really love LM Studio so I gave Bionic a shot immediately. First impression: it works great... but current working directory isn't clear, no way to preload the model, and no easy way to unload it like the eject button in LM Studio.

Built-in AI = 25.2 ÷ 90 × 100 = 28.0

Automation0.0/100×0.15 of the PA blend

Depth of automation primitives — rules, scheduling, bulk operations, webhooks.

Perform bulk operations across many items at onceweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

  • [claimed-docs] https://lmstudio.ai/docs/appLM Studio provides a REST API that you can use to interact with your local models from your own apps and scripts.
  • [claimed-docs] https://lmstudio.ai/docs/clichat Start an interactive chat with a model
  • [claimed-docs] https://lmstudio.ai/docs/cliget Search and download models
  • [claimed-docs] https://lmstudio.ai/docs/clilms server start lms server stop

Define rules that trigger actions automatically on eventsweight 3

3 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 30 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Schedule recurring jobs or workflowsweight 2

2 (weight) × 0 (quality) × 0.0 (none) = 0.0 of 20 max

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Version, review, and roll back my automationsweight 1

n/a — not applicable to this product: excluded from numerator and denominator

no evidence cited — the verdict rests on absence of evidence, re-checked on refresh

Automation = 0.0 ÷ 70 × 100 = 0.0