Issues

• Evaluation integrity: DBBench grader eval() on agent answer; null/NaN answers collapse to zero and match; errored samples silently delete whole task; unauthenticated control plane; OS checks inside agent container

  THUDM/AgentBench#234 · Filter by author AUTHENSOR opened on Sep 3, 2026
  1

• Would an EvalPort export of the QA-style task subsets (DBBench, KnowledgeGraph) be welcome in benchmarks/?

  THUDM/AgentBench#232 · Filter by author adhabnr-ux opened on Aug 22, 2026

• Cross-project discussion: measuring agent capability without collapsing everything into one score

  THUDM/AgentBench#230 · Filter by author KeilerHirsch opened on Aug 14, 2026

• [Bug/Assistance]main分支src.start_task文件缺失导致文档流程无法跑通 The missing src.start_task file in the main branch is causing the readme workflow to fail

  bughelp wanted
  THUDM/AgentBench#225 · Filter by author OumaWu opened on Jun 9, 2026
  1

• Comparison benchmark: ClawBench (live-site browser agent eval with submission-interception)

  THUDM/AgentBench#221 · Filter by author reacher-z opened on Apr 15, 2026

• Potential Issues with Ground Truth Consistency in the Dataset

  THUDM/AgentBench#220 · Filter by author Hoyant-Su opened on Apr 10, 2026

• [Bug/Assistance] src.start_task 文件缺失

  bughelp wanted
  THUDM/AgentBench#212 · Filter by author barry930 opened on Feb 4, 2026

• [Bug/Assistance]os任务进度一直为0

  bughelp wanted
  THUDM/AgentBench#211 · Filter by author shirly35 opened on Jan 20, 2026
  4

• [Bug/Assistance] Operation system dataset has wrong start script.

  bughelp wanted
  THUDM/AgentBench#196 · Filter by author Shuwen27 opened on Aug 6, 2025

• [Bug/Assistance] 在测试ltp的时候遇到了INTERACT_FAILED的问题

  bughelp wanted
  THUDM/AgentBench#194 · Filter by author adoptedirelia opened on May 29, 2025
  3

• DBbench中mysql命令执行的结果，总是没有表

  bughelp wanted
  THUDM/AgentBench#193 · Filter by author Chucy2020 opened on Apr 27, 2025
  2

• 测试国内其它模型效果

  THUDM/AgentBench#192 · Filter by author Chucy2020 opened on Apr 25, 2025

• [Feature] 请求更新，目前数据看起来过时了。

  enhancement
  THUDM/AgentBench#187 · Filter by author d3vw opened on Feb 25, 2025

• [Feature] Adding Large Reasoning Models Results

  enhancement
  THUDM/AgentBench#186 · Filter by author Aaron617 opened on Feb 18, 2025

• [Bug/Assistance] Fix example code for an os task

  bughelp wanted
  THUDM/AgentBench#185 · Filter by author hannagabor opened on Feb 6, 2025

• [Feature] 请问可以支持本地下载环境而非使用docker吗

  enhancement
  THUDM/AgentBench#182 · Filter by author YSLIU627 opened on Jan 24, 2025
  2

• [Bug/Assistance] The wrong entity pattern in task knowledgegraph

  bughelp wanted
  THUDM/AgentBench#181 · Filter by author caixd-220529 opened on Jan 18, 2025

• [Bug/Assistance] View UI

  bughelp wanted
  THUDM/AgentBench#180 · Filter by author auxiliary-kimchi opened on Jan 7, 2025

• [Bug/Assistance] Cert Expired

  bughelp wanted
  THUDM/AgentBench#178 · Filter by author jlsajfj opened on Dec 15, 2024

• [Bug/Assistance] Docker build failed

  bughelp wanted
  THUDM/AgentBench#177 · Filter by author YerongLi opened on Dec 8, 2024
  1

• [Feature] docker alternatives ： 没有admin

  enhancement
  THUDM/AgentBench#175 · Filter by author YerongLi opened on Dec 6, 2024

• [Assistance] OS task retrun infos

  bughelp wanted
  THUDM/AgentBench#173 · Filter by author xiaxiaxiatengxi opened on Nov 19, 2024
  1

• [Bug/Assistance] '{"detail":"Error: Task does not exist"}', 400, 'webshop-std'

  bughelp wanted
  THUDM/AgentBench#170 · Filter by author AlphaLee1113 opened on Oct 23, 2024
  3

• [Data availability] Model trajectories

  enhancement
  THUDM/AgentBench#169 · Filter by author felipemaiapolo opened on Oct 20, 2024

• [Assistance] 如何实现demo视频中的效果

  bughelp wanted
  THUDM/AgentBench#168 · Filter by author XGJ111 opened on Oct 9, 2024