2026-09-10MODELDeepSeek-V4.1-Flash released with extreme agent memory efficiency and evaluated across VALS2026-09-03MODELGPT-6 Astra released by OpenAI - 71.7% on EMB, 63.3% on Tax Agent Bench2026-09-02MODELGoogle Gemini 3.8 Flash takes #1 rank on Finance Agent (v2) with 61.4% and 72.2% on EMB2026-09-02MODELMeta releases Muse Spark 1.3 & 1.3 Max - 59.0%-60.0% on Finance Agent (v2)2026-09-01MODELClaude Fable 5.1 leads Tax Agent Bench (77.6%) and EMB (76.7%) with 75% cheaper cache reads2026-09-11BENCHTax Agent Bench and FAB v2 benchmarks updated with latest frontier model rankings2026-09-15UPDATEPlatform updated: 43 models tracked across 41 independent benchmarks2026-09-10MODELDeepSeek-V4.1-Flash released with extreme agent memory efficiency and evaluated across VALS2026-09-03MODELGPT-6 Astra released by OpenAI - 71.7% on EMB, 63.3% on Tax Agent Bench2026-09-02MODELGoogle Gemini 3.8 Flash takes #1 rank on Finance Agent (v2) with 61.4% and 72.2% on EMB2026-09-02MODELMeta releases Muse Spark 1.3 & 1.3 Max - 59.0%-60.0% on Finance Agent (v2)2026-09-01MODELClaude Fable 5.1 leads Tax Agent Bench (77.6%) and EMB (76.7%) with 75% cheaper cache reads2026-09-11BENCHTax Agent Bench and FAB v2 benchmarks updated with latest frontier model rankings2026-09-15UPDATEPlatform updated: 43 models tracked across 41 independent benchmarks
Tier 3agentTasks

ProgramBench

Program synthesis and execution verification across complex algorithmic challenges.

Variable tasks
17 models evaluated
Updated 2026
3.0%
Top Score
Top model
Claude Opus 5
Model Rankings
financebenchmark.ai · ProgramBench
Anthropic
Anthropic
OpenAI
Moonshot AI
Anthropic
Google
Google
Zhipu AI
OpenAI
OpenAI
xAI
Thinking Machines
Thinking Machines
Moonshot AI
Meta
NVIDIA
Alibaba
0.0%
🥇AnthropicAnthropicClaude Opus 53.0%
🥈AnthropicAnthropicClaude Sonnet 50.0%
🥉OpenAIOpenAIGPT-5.6 Sol1.5%
4Moonshot AIMoonshot AIKimi K3OPEN2.0%
5AnthropicAnthropicClaude Fable 52.0%
6GoogleGoogleGemini 3.5 Flash Lite0.0%
7GoogleGoogleGemini 3.6 Flash0.0%
8Zhipu AIZhipu AIGLM 5.2OPEN0.5%
9OpenAIOpenAIGPT-5.6 Luna0.0%
10OpenAIOpenAIGPT-5.6 Terra0.5%
11xAIxAIGrok 4.50.0%
12Thinking MachinesThinking MachinesInklingOPEN0.0%
13Thinking MachinesThinking MachinesInkling SmallOPEN0.5%
14Moonshot AIMoonshot AIKimi K2.7 CodeOPEN0.0%
15MetaMetaMuse Spark 1.10.0%
16NVIDIANVIDIANemotron 3 UltraOPEN0.0%
17AlibabaAlibabaQwen 3.8 MaxOPEN0.0%
Full Results Table
#ModelOverallSourceDate
🥇
AnthropicClaude Opus 5
Anthropic
3.0VALS (2026)2026-07
🥈
Moonshot AIKimi K3OPEN
Moonshot AI
2.0VALS (2026)2026-07
🥉
AnthropicClaude Fable 5
Anthropic
2.0VALS (2026)2026-06
4
OpenAIGPT-5.6 Sol
OpenAI
1.5VALS (2026)2026-07
5
Zhipu AIGLM 5.2OPEN
Zhipu AI
0.5VALS (2026)2026-06
6
OpenAIGPT-5.6 Terra
OpenAI
0.5VALS (2026)2026-07
7
Thinking MachinesInkling SmallOPEN
Thinking Machines
0.5VALS (2026)2026-07
8
AnthropicClaude Sonnet 5
Anthropic
0.0VALS (2026)2026-06
9
GoogleGemini 3.5 Flash Lite
Google
0.0VALS (2026)2026-07
10
GoogleGemini 3.6 Flash
Google
0.0VALS (2026)2026-07
11
OpenAIGPT-5.6 Luna
OpenAI
0.0VALS (2026)2026-07
12
xAIGrok 4.5
xAI
0.0VALS (2026)2026-07
13
Thinking MachinesInklingOPEN
Thinking Machines
0.0VALS (2026)2026-07
14
Moonshot AIKimi K2.7 CodeOPEN
Moonshot AI
0.0VALS (2026)2026-06
15
MetaMuse Spark 1.1
Meta
0.0VALS (2026)2026-07
16
NVIDIANemotron 3 UltraOPEN
NVIDIA
0.0VALS (2026)2026-06
17
AlibabaQwen 3.8 MaxOPEN
Alibaba
0.0VALS (2026)2026-08