Kyle Wiggers / TechCrunch:

AI reasoning models cost more to benchmark, making it harder to independently verify claims; Artificial Analysis says evaluating OpenAI's o1 costs $2,767.05  —  AI labs like OpenAI claim that their so-called “reasoning” AI models, which can “think” through problems step by step …

Kyle Wiggers / TechCrunch:

AI reasoning models cost more to benchmark, making it harder to independently verify claims; Artificial Analysis says evaluating OpenAI's o1 costs $2,767.05  —  AI labs like OpenAI claim that their so-called “reasoning” AI models, which can “think” through problems step by step …

Source: TechMeme
Source Link: http://www.techmeme.com/250411/p9#a250411p9