AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Gemma 4 12B (Reasoning): gpqa

Artificial Analysis · observation · Publication date unknown

Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.

Read original source ↗ Open in workspace

recordType
observation
region
Global
value
0.753
unit
score
dimensions
{"metric":"gpqa","model":"feb02d3b-ff8d-4ed4-b165-13f8d4a7192c","parallel_queries":1,"prompt_length":1000}

Evidence & attribution

Artificial Analysis

First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.

Observed changes

AIIC observation times, not verified publisher revision times. Up to eight recent revisions.

2026-09-26T16:33:30.713Z

  • performance: {"outputTokensPerSecond":146.587,"timeToFirstAnswerTokenSeconds":15.005,"timeToFirstTokenSeconds":1.361} → {"outputTokensPerSecond":148.901,"timeToFirstAnswerTokenSeconds":14.882,"timeToFirstTokenSeconds":1.451}

2026-09-25T16:23:29.199Z

  • performance: {"outputTokensPerSecond":141.263,"timeToFirstAnswerTokenSeconds":15.467,"timeToFirstTokenSeconds":1.309} → {"outputTokensPerSecond":146.587,"timeToFirstAnswerTokenSeconds":15.005,"timeToFirstTokenSeconds":1.361}

2026-09-24T16:13:45.287Z

  • performance: {"outputTokensPerSecond":141.956,"timeToFirstAnswerTokenSeconds":15.386,"timeToFirstTokenSeconds":1.297} → {"outputTokensPerSecond":141.263,"timeToFirstAnswerTokenSeconds":15.467,"timeToFirstTokenSeconds":1.309}

2026-09-23T16:13:28.179Z

  • performance: {"outputTokensPerSecond":138.597,"timeToFirstAnswerTokenSeconds":15.74,"timeToFirstTokenSeconds":1.309} → {"outputTokensPerSecond":141.956,"timeToFirstAnswerTokenSeconds":15.386,"timeToFirstTokenSeconds":1.297}

2026-09-22T16:03:50.148Z

  • performance: {"outputTokensPerSecond":140.005,"timeToFirstAnswerTokenSeconds":15.666,"timeToFirstTokenSeconds":1.381} → {"outputTokensPerSecond":138.597,"timeToFirstAnswerTokenSeconds":15.74,"timeToFirstTokenSeconds":1.309}

2026-09-20T21:52:07.471Z

  • pricing: Not provided → {"input":0.1,"output":0.3}
  • performance: Not provided → {"outputTokensPerSecond":140.005,"timeToFirstAnswerTokenSeconds":15.666,"timeToFirstTokenSeconds":1.381}