AINEWS 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Nvidia 论文提出 VERA:交替训练智能体与修改技能文件

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

VERA 将长任务拆成可逐步核查的环节,利用真实文件和日志评分,再决定下一轮改进模型还是技能文件。在一项医学研究基准测试中,9B 智能体采用两种更新方式得分 69.1,仅修改技能文件为 56.1,仅训练模型为 43.3。

正文 · 原文

该语言的正文暂不可用,当前显示已有版本。

New Nvidia paper shows agents for long, multi-step work improve most when you alternate between training the model and editing its skill files, using step-by-step scores from real evidence to pick each fix.

Training only the model or only the harness leaves about half the gain on the table, compared with updating both in alternating rounds.

Most environments score only the final result, which hides which step broke. VERA builds over 9,000 restartable sandboxes that check each step against real files and logs, then improves the agent in rounds.

VERA turns benchmark runs into over 9,000 restartable sandboxes where each step of a long workflow gets its own checklist score from real evidence.

On a medical research benchmark, a 9B agent scored 69.1 with both kinds of updates, versus 56.1 with skill edits alone and 43.3 with training alone.

Score each step against real artifacts, and let those scores decide whether the next fix goes into the model or its skills.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错