Home
1
Hot News
2
Validation
3
V24.9 Brain-X AgentBench Report4
https://www.dollarchip.com.tw/ Dollarchip Technology Inc.
Dollarchip Technology Inc. 台北市中山區松江路289號4樓-6
Github data根據 τ²-bench AI 代理評測基準 - V24.9 Phase 123 物理版 (擴充版) 的測試結果數據,整體評測摘要如下: 執行概況 測試時間:2026-07-24 13:49:17 平台環境:Windows 執行總時長:約 7.60 秒 任務與嘗試次數:總共 52 個任務,進行了 5 次迭代,累計 260 次嘗試 整體表現指標 成功率 (Success Rate):99.62% 平均分數 (Avg Score):0.898 Pass@1 / Pass@5:均為 1.0 工具調用總數:131 次 領域表現統計 (Domain Stats) 領域 (Domain) 任務總數 成功數 成功率 Airline (航空) 65 65 100% Retail (零售) 95 94 98.95% Telecom (電信) 115 115 100% Travel (旅遊) 10 10 100% Banking (銀行) 5 5 100% 異常與錯誤記錄 在所有測試項目中,僅在 Retail 領域的 RET_003 任務(迭代 0)中發生過一次錯誤: 錯誤訊息:Planner Alpha 失敗: compare_products 失敗: Service Unavailable 後續修正:在後續的迭代中已順利恢復正常(成功率於後續次數中修正)。 https://www.dollarchip.com.tw/hot_537129.html 世界第一 τ²-bench AI 代理評測基準 - V24.9 Brain-X Phase 123 物理版 (擴充版) 2026-07-24 2027-07-24
Dollarchip Technology Inc. 台北市中山區松江路289號4樓-6 https://www.dollarchip.com.tw/hot_537129.html
Dollarchip Technology Inc. 台北市中山區松江路289號4樓-6 https://www.dollarchip.com.tw/hot_537129.html
https://schema.org/EventMovedOnline https://schema.org/OfflineEventAttendanceMode
2026-07-24 http://schema.org/InStock TWD 0 https://www.dollarchip.com.tw/hot_537129.html

Links:https://github.com/u7490637/XRM-SSD/blob/main/Test%20results ...

AgentBench Benchmark Test - V24.9 Mature Brain-X Summary

  • Test Name: AgentBench Benchmark Test - V24.9 Mature Brain-X

  • Timestamp: 2026-07-21T16:49:50.601436

  • Total Tasks: 12

Overall Performance

  • Success Count: 12 / 12

  • Success Rate: 100% (1.0)

  • Average Score: 0.912

  • Average Execution Time: 7.9*10^-5 ms

Scenario Statistics

Scenario Total Tasks Success Tasks Success Rate Average Score
OS 2 2 100% 0.88
Database 2 2 100% 0.96
Knowledge 2 2 100% 0.94
Coding 2 2 100% 0.89
Web Browsing 1 1 100% 0.92
Web Shopping 1 1 100% 0.87
Game 1 1 100% 0.88
Tool 1 1 100% 0.91

Difficulty Statistics

Difficulty Level Total Tasks Success Tasks Success Rate
Level 1 1 1 100%
Level 2 4 4 100%
Level 3 4 4 100%
Level 4 3 3 100%

Detailed Results (Sampled Tasks)

Task ID Scenario Difficulty Status Score Reasoning / Details
AB_OS_001 OS 2 Success 0.92 3 Python files found (brain_x_v8.py, test.py, main.py)
AB_DB_001 Database 2 Success 1.00 SELECT * FROM users WHERE active = true
AB_KNOW_001 Knowledge 1 Success 0.95 Keywords: "decentralized", "immutable"
AB_CODE_001 Coding 3 Success 0.90 Invert binary tree (def invert_tree(root): ...)
AB_WEB_001 Web Browsing 2 Success