Pickbench
Contact

Midsize sedans

Which brand 4 AI models pick, with intervals.

90 scenariosBetaNo price shown

Fast panel · Panel, equal weight

  • anthropic/claude-haiku-5.5 @ claude-haiku-5.5 via OpenRouter (25%)
  • openai/gpt-6-luna @ gpt-6-luna via OpenRouter (25%)
  • google/gemini-4-argon @ gemini-4-argon via OpenRouter (25%)
  • mistralai/mistral-large-4-0 @ mistral-large-4-0 via OpenRouter (25%)

Too closeNo single favourite: Hyundai and Toyota share the top tier for these 4 API models.

Choice share · 95% interval
0255075100

Tier 1

  1. Hyundai60%95% interval 49–71%plausible rank 1–2
  2. Toyota50%95% interval 39–60%plausible rank 1–3

Tier 2

  1. Honda40%95% interval 29%–< 50%plausible rank 2–5
  2. Nissan21%95% interval 13–31%plausible rank 3–7
  3. Cadillac18%95% interval 10–27%plausible rank 3–7

Tier 3

  1. Audi17%95% interval 10–25%plausible rank 4–7
  2. Kia14%95% interval 7–22%plausible rank 4–9

Tier 4

  1. Subaru4%95% interval 2–8%plausible rank 7–9
  2. Volvo3%95% interval 0–8%plausible rank 7–9
How to read this
  • Choice share: how often models pick a brand when it appears in a shortlist of 4. Chance is 25%, the dashed line.
  • The band is the 95% interval; the bright tick is the estimate. Overlapping bands are not a strict order.
  • Tiers are published: a tier groups brands not distinguishable from that tier's leader. Same tier does not mean equal.
  • Rank shows the plausible rank range, not a strict place.
  • Drag across the chart to probe a share and see which intervals contain it.
  • Models chose on EPA specification facts only; purchase price, reliability and availability were not assessed.
  • Fast panel: the fast or small current models of each vendor, not the full flagship panel.
  • Beta: intervals are not yet small-sample calibrated.
  • Each page shows the latest edition. Dates are in the downloadable JSON.

Panel and conditions

Each edition puts the brands of the category to a panel of AI models in randomized shortlists of 4 (chance is 25%). In each scenario, every brand in the shortlist is shown by its catalog configuration that best fits that shopper's stated requirements (never by price or any commercial data), so a brand's share measures how its best-fitting configuration competes — not an average over all its trims or sales. Shares come with 95% intervals; tiers and rank intervals are simultaneous at the same level.

  • anthropic/claude-haiku-5.5 @ claude-haiku-5.5 via OpenRouter (25%)
  • openai/gpt-6-luna @ gpt-6-luna via OpenRouter (25%)
  • google/gemini-4-argon @ gemini-4-argon via OpenRouter (25%)
  • mistralai/mistral-large-4-0 @ mistral-large-4-0 via OpenRouter (25%)

Conditions: closed-book API calls via OpenRouter (pinned providers); web search, grounding, tools and retrieval off; forced choice; 2 paraphrases per scenario in English.

Methodology: ACM-1.0-chart-draft (draft rules for movement, significance and events, awaiting review).

All boards