AINEWS Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Nvidia paper proposes VERA to alternate agent training and skill file editsMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

VERA scores individual steps in long tasks against real files and logs, then uses those scores to choose whether to improve the model or its skill files next. On a medical research benchmark, a 9B agent scored 69.1 with both kinds of updates, compared with 56.1 for skill edits alone and 43.3 for training alone.

Article · Original

The article text is unavailable in this language; an existing version is shown.

New Nvidia paper shows agents for long, multi-step work improve most when you alternate between training the model and editing its skill files, using step-by-step scores from real evidence to pick each fix.

Training only the model or only the harness leaves about half the gain on the table, compared with updating both in alternating rounds.

Most environments score only the final result, which hides which step broke. VERA builds over 9,000 restartable sandboxes that check each step against real files and logs, then improves the agent in rounds.

VERA turns benchmark runs into over 9,000 restartable sandboxes where each step of a long workflow gets its own checklist score from real evidence.

On a medical research benchmark, a 9B agent scored 69.1 with both kinds of updates, versus 56.1 with skill edits alone and 43.3 with training alone.

Score each step against real artifacts, and let those scores decide whether the next fix goes into the model or its skills.

来源:Rohan Paul · x.com

Research
Found an error? Send a correction