AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Hermes 4 - Llama-3.1 405B (Non-reasoning): ifbench

Artificial Analysis · observation · Publication date unknown

Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.

Read original source ↗ Open in workspace

recordType
observation
region
Global
value
0.347619047619048
unit
score
dimensions
{"metric":"ifbench","model":"d3968fd3-97d8-4693-8d26-19cefc6f5d5f","parallel_queries":1,"prompt_length":1000}

Evidence & attribution

Artificial Analysis

First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.

Observed changes

AIIC observation times, not verified publisher revision times. Up to eight recent revisions.

2026-09-26T16:33:30.713Z

  • performance: {"outputTokensPerSecond":42.028,"timeToFirstAnswerTokenSeconds":0.751,"timeToFirstTokenSeconds":0.751} → {"outputTokensPerSecond":44.414,"timeToFirstAnswerTokenSeconds":0.7,"timeToFirstTokenSeconds":0.7}

2026-09-25T16:23:29.199Z

  • performance: {"outputTokensPerSecond":38.534,"timeToFirstAnswerTokenSeconds":0.787,"timeToFirstTokenSeconds":0.787} → {"outputTokensPerSecond":42.028,"timeToFirstAnswerTokenSeconds":0.751,"timeToFirstTokenSeconds":0.751}

2026-09-24T16:13:45.287Z

  • performance: {"outputTokensPerSecond":38.272,"timeToFirstAnswerTokenSeconds":0.903,"timeToFirstTokenSeconds":0.903} → {"outputTokensPerSecond":38.534,"timeToFirstAnswerTokenSeconds":0.787,"timeToFirstTokenSeconds":0.787}

2026-09-23T16:13:28.179Z

  • performance: {"outputTokensPerSecond":40.827,"timeToFirstAnswerTokenSeconds":0.792,"timeToFirstTokenSeconds":0.792} → {"outputTokensPerSecond":38.272,"timeToFirstAnswerTokenSeconds":0.903,"timeToFirstTokenSeconds":0.903}

2026-09-22T16:03:50.148Z

  • performance: {"outputTokensPerSecond":44.368,"timeToFirstAnswerTokenSeconds":0.782,"timeToFirstTokenSeconds":0.782} → {"outputTokensPerSecond":40.827,"timeToFirstAnswerTokenSeconds":0.792,"timeToFirstTokenSeconds":0.792}

2026-09-20T21:52:07.471Z

  • pricing: Not provided → {"input":1,"output":3}
  • performance: Not provided → {"outputTokensPerSecond":44.368,"timeToFirstAnswerTokenSeconds":0.782,"timeToFirstTokenSeconds":0.782}