Gemma 3 27B
Gemma 3 27B is a model from Google, run through Amazon Bedrock. It places 10= of 14 on the Hurdle Index, and falls below the 90% bar on pay-gap reasoning.
- Lab
- Called as
google.gemma-3-27b-it- Price, per million tokens
- $0.12 in, $0.38 out
- Tokens per task
- 2,014 read, 2,008 written
- Output limit
- 32,000 tokens
- Run
- 23 October 2026, 120 attempts
Hurdle Index
3.3%2.2% to 4.5%. Place 10= of 14.Cost per task
$0.00104th cheapest of 14. List price of the tokens used.Time per task
29 s8th fastest of 14. Wall-clock time of each call.On each benchmark
| Benchmark | Mean, 95% interval | Place | Every run | Best of 3 | Cost per task | Cut off | Bar |
|---|---|---|---|---|---|---|---|
| Pay-gap reasoning | 3.3% 2.2% to 4.5% | 10= of 14 | 0.1% | 7.7% | $0.0010 | none | Below |
Every attempt
Pay-gap reasoning: 40 tasks, three attempts each, one cell per attempt. White is a perfect answer, black is none of it right.
Attempt 1
Attempt 2
Attempt 3
Where it misses
The share of each kind of rubric line it got wrong, across every attempt.
Next to it on the index
Is it right for your job?
A public benchmark says how it does on someone else’s work. Hurdle builds one from yours.
Book a walkthrough