Quickstart Guide
Run your first blind model comparison in under 5 minutes.
1Create an account
Sign up for a free account at compare-hub.com. No credit card required. You'll get free credits to run your first comparisons.
💡 Tip: You can also use your own OpenRouter or provider API keys to avoid using platform credits. See API Keys.
2Pick a task or paste your prompt
Choose from pre-built task templates (chat, summarization, code generation, etc.) or paste your own prompt. You can use variables like {{topic}} to make prompts reusable.
System: You are a helpful assistant.
User: Explain {{topic}} in simple terms.3Select models to compare
Choose 2 or more models from our library. By default, model names are hidden (blind mode) to prevent brand bias. You can reveal them anytime.
- •Models are labeled as A, B, C, etc. until you reveal them
- •Compare up to 30 models in a single run
- •See real-time cost and latency for each model
4Run comparison & review results
Click "Run comparison" and wait for models to respond. An ensemble of judges will evaluate the outputs based on criteria like correctness, clarity, and efficiency.
You'll see:
- •Scores - Judge ratings with visible rationales
- •Agreement - How often judges picked the same winner
- •Cost & Speed - € per run and latency in milliseconds
- •Permalink - Shareable URL with pinned versions