METR
@METR_Evals
Introducing “expenditure horizon”: a proposed method for measuring AI capabilities on continuously-scored problems.
The method compares performance as a function of spend for humans vs agents. The point where humans become more cost-effective is the agent’s expenditure horizon.
The method compares performance as a function of spend for humans vs agents. The point where humans become more cost-effective is the agent’s expenditure horizon.
14 759