AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

o3: terminalbench hard

Artificial Analysis · observation · Publication date unknown

Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.

Read original source ↗ Open in workspace

recordType
observation
region
Global
value
0.371212121212121
unit
score
dimensions
{"metric":"terminalbench_hard","model":"16c5b637-8bce-4252-81f2-1b87a36a4e4c","parallel_queries":1,"prompt_length":1000}

Evidence & attribution

Artificial Analysis

First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.

Observed changes

AIIC observation times, not verified publisher revision times. Up to eight recent revisions.

2026-09-26T16:33:30.713Z

  • performance: {"outputTokensPerSecond":128.094,"timeToFirstAnswerTokenSeconds":9.313,"timeToFirstTokenSeconds":9.313} → {"outputTokensPerSecond":130.062,"timeToFirstAnswerTokenSeconds":8.532,"timeToFirstTokenSeconds":8.532}

2026-09-25T16:23:29.199Z

  • performance: {"outputTokensPerSecond":120.166,"timeToFirstAnswerTokenSeconds":7.32,"timeToFirstTokenSeconds":7.32} → {"outputTokensPerSecond":128.094,"timeToFirstAnswerTokenSeconds":9.313,"timeToFirstTokenSeconds":9.313}

2026-09-24T16:13:45.287Z

  • performance: {"outputTokensPerSecond":135.077,"timeToFirstAnswerTokenSeconds":6.712,"timeToFirstTokenSeconds":6.712} → {"outputTokensPerSecond":120.166,"timeToFirstAnswerTokenSeconds":7.32,"timeToFirstTokenSeconds":7.32}

2026-09-23T16:13:28.179Z

  • performance: {"outputTokensPerSecond":154.946,"timeToFirstAnswerTokenSeconds":5.684,"timeToFirstTokenSeconds":5.684} → {"outputTokensPerSecond":135.077,"timeToFirstAnswerTokenSeconds":6.712,"timeToFirstTokenSeconds":6.712}

2026-09-22T16:03:50.148Z

  • performance: {"outputTokensPerSecond":152.348,"timeToFirstAnswerTokenSeconds":4.616,"timeToFirstTokenSeconds":4.616} → {"outputTokensPerSecond":154.946,"timeToFirstAnswerTokenSeconds":5.684,"timeToFirstTokenSeconds":5.684}

2026-09-20T21:52:07.471Z

  • pricing: Not provided → {"input":2,"output":8}
  • performance: Not provided → {"outputTokensPerSecond":152.348,"timeToFirstAnswerTokenSeconds":4.616,"timeToFirstTokenSeconds":4.616}