SOURCE-LINKED INTELLIGENCE
Llama Nemotron Super 49B v1.5 (Reasoning): terminalbench hard
Artificial Analysis · observation · Publication date unknown
Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.
Read original source ↗ Open in workspace
- recordType
- observation
- region
- Global
- value
- 0.053030303030303
- unit
- score
- dimensions
- {"metric":"terminalbench_hard","model":"e1cfa926-9e2b-4a0d-8c31-48366a5041c5","parallel_queries":1,"prompt_length":1000}
Evidence & attribution
Artificial Analysis
First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.
Observed changes
AIIC observation times, not verified publisher revision times. Up to eight recent revisions.
2026-09-24T16:13:45.287Z
- pricing:
{"input":0.4,"output":0.4} → {"input":0,"output":0} - performance:
{"outputTokensPerSecond":28.3,"timeToFirstAnswerTokenSeconds":80.685,"timeToFirstTokenSeconds":10.014} → {"outputTokensPerSecond":0,"timeToFirstAnswerTokenSeconds":0,"timeToFirstTokenSeconds":0}
2026-09-23T16:13:28.179Z
- performance:
{"outputTokensPerSecond":110.726,"timeToFirstAnswerTokenSeconds":21.827,"timeToFirstTokenSeconds":3.765} → {"outputTokensPerSecond":28.3,"timeToFirstAnswerTokenSeconds":80.685,"timeToFirstTokenSeconds":10.014}
2026-09-22T16:03:50.148Z
- performance:
{"outputTokensPerSecond":139.174,"timeToFirstAnswerTokenSeconds":17.183,"timeToFirstTokenSeconds":2.812} → {"outputTokensPerSecond":110.726,"timeToFirstAnswerTokenSeconds":21.827,"timeToFirstTokenSeconds":3.765}
2026-09-20T21:52:07.471Z
- pricing:
Not provided → {"input":0.4,"output":0.4} - performance:
Not provided → {"outputTokensPerSecond":139.174,"timeToFirstAnswerTokenSeconds":17.183,"timeToFirstTokenSeconds":2.812}