Pickbench
Contact

Carnival Cruise Line vs Royal Caribbean

Cruise lines60 scenarios

Panel, equal weight

  • Claude Haiku 5.5anthropic/claude-haiku-5.5
  • DeepSeek V4.1 Flashdeepseek/deepseek-v4.1-flash
  • Gemini 3.8 Flashgoogle/gemini-3.8-flash
  • GLM-5.3 Flashz-ai/glm-5.3-flash
  • GPT-6 Lunaopenai/gpt-6-luna
  • Grok 4.7x-ai/grok-4.7
  • Kimi K3.1 Promoonshotai/kimi-k3.1-pro
  • Llama 4 Maverickmeta-llama/llama-4-maverick-17b-128e-instruct
  • Mistral Small 2603mistralai/mistral-small-2603
  • Qwen3.8 Flashqwen/qwen3.8-flash

The answer

ClearFast panel

Royal Caribbean

Royal Caribbean 94% · Carnival Cruise Line 6% — all 10 models combined

10 clearly prefer Royal Caribbean · 0 with no clear preference · 0 clearly prefer Carnival Cruise Line · all 10 models count in the overall result

95% interval for Royal Caribbean: 89–97%

Detailseach model, intervals, conditions

All models combined

Fast panel

ClearAll 10 models combined lean Royal Caribbean (the interval excludes 50%); on their own: 10 clearly prefer Royal Caribbean · 0 with no clear preference · 0 clearly prefer Carnival Cruise Line.

Carnival Cruise Line6%

Royal Caribbean94%

  • Confidence interval for Carnival Cruise Line: 3–11%

Consensus95% interval 3–11%

Each model

Share for the brand named in each row, with its interval

Bar: Carnival Cruise Line from the left, Royal Caribbean from the right; dashed line = 50%.

Conditional pick share by judge for the brand named in each row (among scenarios where the judge picked a brand), with confidence intervals. 95% confidence intervals (hull of the scenario-clustered bootstrap and Wilson intervals, widened for small samples in battles and newer boards)
Judge (API model)Brand and shareConfidence intervalLeaningInterval chart
Claude Haiku 5.5Royal Caribbean: 95%90–99%Clear preference
DeepSeek V4.1 FlashRoyal Caribbean: 97%91–100%Clear preference
Gemini 3.8 FlashRoyal Caribbean: 100%97–100%Clear preference
GLM-5.3 FlashRoyal Caribbean: 85%75–93%Clear preference
GPT-6 LunaRoyal Caribbean: 90%84–95%Clear preference
Grok 4.7Royal Caribbean: 98%94–100%Clear preference
Kimi K3.1 ProRoyal Caribbean: 100%93–100%Clear preference
Llama 4 MaverickRoyal Caribbean: 96%91–99%Clear preference
Mistral Small 2603Royal Caribbean: 83%75–89%Clear preference
Qwen3.8 FlashRoyal Caribbean: 95%89–99%Clear preference

What would you pick?

How votes are counted

Your vote is sent to Pickbench and counts once per browser for this battle. You can change it.

Visitors' votes are shown next to the AI results for comparison only and are never mixed into the AI numbers.

Visitors who voted

Open online poll of Pickbench visitors, not a representative survey.

No visitor votes have been counted yet.

How votes are counted

Replay it as a dropSimulated
Carnival Cruise Line
Royal Caribbean

Simulation: scenario paths made up to reproduce the published per-judge shares, not measured rows.

The AI consensus leans to Royal Caribbean

Published 95% confidence interval for Carnival Cruise Line: 3–11%. Press Drop to watch simulated scenarios land.

How to read it

Each ball is a simulated buying scenario. Each row of pins is an AI model, pushing the ball toward the brand it picked.

One drop is one sample. Drop again and the pile shifts; the orange band shows where the balance lands in 95% of drops.

A leader is named only when the band clears the middle. The paths are simulated from the published per-judge shares: no model saw these scenarios.

Tap to drop. Hold to keep dropping.

The numbers behind the machine
Signed snapshot0c2663fc5573JSON
Embed

Free to embed. It shows the latest edition; keep the source line and the link.

Static card (SVG)

How this was measured · verify

How to read

The share is how often the models chose each brand, with its 95% interval. A brand leads only when its whole interval is above 50%, for all models combined and for each model on its own; otherwise it is too close to call.

Each page shows the latest edition. Dates are in the downloadable JSON.

Who was counted

  • The pre-registered inclusion rule counted 10 of the 10 judges on the panel.
  • The results use 60 of the 60 planned scenarios.
  • Every judge on the panel met the rule.
Consensus weights of 10 counted judges
Weight of each counted judge in the consensus
Judge (API model)Model familyWeight in the consensus
Claude Haiku 5.5Anthropic10.0%
DeepSeek V4.1 FlashDeepSeek10.0%
Gemini 3.8 FlashGoogle10.0%
GLM-5.3 FlashZ.ai10.0%
GPT-6 LunaOpenAI10.0%
Grok 4.7xAI10.0%
Kimi K3.1 ProMoonshot AI10.0%
Llama 4 MaverickMeta10.0%
Mistral Small 2603Mistral AI10.0%
Qwen3.8 FlashQwen10.0%

Need-level results

Need-level results are not published: 6 scenarios per need, below the pre-registered minimum of 30.

10 buyer needs
  • Couples and anniversaries
  • Onboard dining variety
  • Live music and entertainment
  • Shore excursions
  • Island and coastal itineraries
  • Ocean-view and balcony cabins
  • Spa, fitness and sun deck
  • Loyalty perks and attentive crew
  • Online check-in and planning
  • Solo and adult friends trips

Methodology

Each judge is an AI model called through an API; “About this result” names each model and how it was called. In each buyer scenario, the judge chooses between the two brands. The scenario is the unit of analysis.

Version
ACM-1.0
Precision
Measured
Consensus, needs and languages
95% confidence intervals (MOVER combination of the per-judge intervals, widened for small samples in battles and newer boards). The consensus gives equal weight to each model family. The per-judge results in “Each model” are the primary measure.
Per judge
95% confidence intervals (hull of the scenario-clustered bootstrap and Wilson intervals, widened for small samples in battles and newer boards). A single model's view is one judge, not the consensus.
Panel
Fast panel: the fast or small current models of each vendor, not the full flagship panel.

Data warnings

  • Brand names only: the models saw each option as a brand name, with no product facts, and answered from their own knowledge.

About this result

AI models (API)
  • Claude Haiku 5.5
  • DeepSeek V4.1 Flash
  • Gemini 3.8 Flash
  • GLM-5.3 Flash
  • GPT-6 Luna
  • Grok 4.7
  • Kimi K3.1 Pro
  • Llama 4 Maverick
  • Mistral Small 2603
  • Qwen3.8 Flash

Every model was called via OpenRouter (pinned providers).

Conditions
Each model chose between the two brands in 60 buyer scenarios. Scenario languages: English.
Pre-registration (SHA-256)
04c88ed73e3a… What the pre-registration fixes
Signed snapshot

Verify this result: download the signed snapshot (JSON)

Signing key (kid)
FnG9tqyrr6Y0… · Production key
SHA-256 of the payload
0c2663fc5573…

How to verify a snapshot

Rank, inclusion and influence on results are never sold.