AINEWS 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google 论文提出 AIM,让研究代理按主题筛选思路并核对代码

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

这项研究称,AIM 将候选思路归入排序后的主题,在每轮探索中兼顾已有较强方向和未经测试的方向,并检查代码是否真正对应所评估的思路。材料称,它在两组任务上比此前表现最好的代理 ScientistOne 分别高 1.6 和 4.9 分,达到对方最佳分数的速度最多快 3.1 倍。

正文 · 原文

该语言的正文暂不可用,当前显示已有版本。

New Google paper shows research agents get better results sooner when they keep a ranked map of ideas and check that code matches each idea, so build both in.

Most agents just keep editing code.

When code drifts from the idea it's scored as, the agent learns the wrong lesson.

AIM sorts ideas into ranked themes and splits each round between strong themes and untested ones. An auditor tosses gamed results and relabels ideas to match the code.

It beat the best prior agent, ScientistOne, by 1.6 and 4.9 points on 2 task groups, and matched ScientistOne's best score up to 3.1x sooner.

Expect the biggest gains on tasks with many possible approaches and few good ones.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错