2026-09-24T16:13:45.287Z
- performance:
{"outputTokensPerSecond":149.338,"timeToFirstAnswerTokenSeconds":0.674,"timeToFirstTokenSeconds":0.674}→ {"outputTokensPerSecond":0,"timeToFirstAnswerTokenSeconds":0,"timeToFirstTokenSeconds":0}
SOURCE-LINKED INTELLIGENCE
Devstral Small 2: terminalbench hard
Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.
Read original source ↗ Open in workspace
- recordType
- observation
- region
- Global
- value
- 0.166666666666667
- unit
- score
- dimensions
- {"metric":"terminalbench_hard","model":"ce819310-af7c-49d3-9a02-6845111e1788","parallel_queries":1,"prompt_length":1000}
Evidence & attribution
Artificial Analysis
First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.
Observed changes
AIIC observation times, not verified publisher revision times. Up to eight recent revisions.
2026-09-23T16:13:28.179Z
- performance:
{"outputTokensPerSecond":149.338,"timeToFirstAnswerTokenSeconds":0.722,"timeToFirstTokenSeconds":0.722}→ {"outputTokensPerSecond":149.338,"timeToFirstAnswerTokenSeconds":0.674,"timeToFirstTokenSeconds":0.674}
2026-09-22T16:03:50.148Z
- performance:
{"outputTokensPerSecond":137.196,"timeToFirstAnswerTokenSeconds":0.722,"timeToFirstTokenSeconds":0.722}→ {"outputTokensPerSecond":149.338,"timeToFirstAnswerTokenSeconds":0.722,"timeToFirstTokenSeconds":0.722}
2026-09-20T21:52:07.471Z
- pricing:
Not provided→ {"input":0,"output":0} - performance:
Not provided→ {"outputTokensPerSecond":137.196,"timeToFirstAnswerTokenSeconds":0.722,"timeToFirstTokenSeconds":0.722}