AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Hermes 4 - Llama-3.1 405B (Reasoning): aime 25

Artificial Analysis · observation · Publication date unknown

Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.

Read original source ↗ Open in workspace

recordType
observation
region
Global
value
0.696666666666667
unit
score
dimensions
{"metric":"aime_25","model":"82b207dd-d285-4a52-b2fc-2cbd27543899","parallel_queries":1,"prompt_length":1000}

Evidence & attribution

Artificial Analysis

First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.

Observed changes

AIIC observation times, not verified publisher revision times. Up to eight recent revisions.

2026-09-26T16:33:30.713Z

  • performance: {"outputTokensPerSecond":43.738,"timeToFirstAnswerTokenSeconds":46.452,"timeToFirstTokenSeconds":0.726} → {"outputTokensPerSecond":44.567,"timeToFirstAnswerTokenSeconds":45.573,"timeToFirstTokenSeconds":0.697}

2026-09-25T16:23:29.199Z

  • performance: {"outputTokensPerSecond":39.947,"timeToFirstAnswerTokenSeconds":50.821,"timeToFirstTokenSeconds":0.755} → {"outputTokensPerSecond":43.738,"timeToFirstAnswerTokenSeconds":46.452,"timeToFirstTokenSeconds":0.726}

2026-09-24T16:13:45.287Z

  • performance: {"outputTokensPerSecond":39.422,"timeToFirstAnswerTokenSeconds":51.585,"timeToFirstTokenSeconds":0.851} → {"outputTokensPerSecond":39.947,"timeToFirstAnswerTokenSeconds":50.821,"timeToFirstTokenSeconds":0.755}

2026-09-23T16:13:28.179Z

  • performance: {"outputTokensPerSecond":40.872,"timeToFirstAnswerTokenSeconds":49.758,"timeToFirstTokenSeconds":0.825} → {"outputTokensPerSecond":39.422,"timeToFirstAnswerTokenSeconds":51.585,"timeToFirstTokenSeconds":0.851}

2026-09-22T16:03:50.148Z

  • performance: {"outputTokensPerSecond":43.3,"timeToFirstAnswerTokenSeconds":46.949,"timeToFirstTokenSeconds":0.76} → {"outputTokensPerSecond":40.872,"timeToFirstAnswerTokenSeconds":49.758,"timeToFirstTokenSeconds":0.825}

2026-09-20T21:52:07.471Z

  • pricing: Not provided → {"input":1,"output":3}
  • performance: Not provided → {"outputTokensPerSecond":43.3,"timeToFirstAnswerTokenSeconds":46.949,"timeToFirstTokenSeconds":0.76}