AI benchmarking organization criticized for waiting to disclose funding from OpenAI
An organization developing math benchmarks for AI didn't disclose that it had received funding from OpenAI until relatively ...
OpenAI Secretly Funded Benchmarking Dataset Linked To o3 Model
OpenAI secretly funded and had access to a benchmarking dataset, raising questions about high scores achieved by its new o3 ...
When A.I. Passes This Test, Look Out
The creators of a new test called “Humanity’s Last Exam” argue we may soon lose the ability to create tests hard enough for A ...
Digital information world3d
AI Benchmark Group Under Fire for Delayed Disclosure of OpenAI Funding
Contributors criticize FrontierMath’s undisclosed OpenAI funding, highlighting secrecy, transparency issues, and ethical ...
OpenAI Just Pulled a Theranos with o3: Transparency Questions Emerge
OpenAI just pulled a Theranos with o3 by claiming record-breaking performance on the FrontierMath benchmark while having ...
Analytics India Magazine10d
As Machines Get Smart, AI Benchmarks Need to Get Smarter
FrontierMath is part of a larger effort to rethink how we measure intelligence. As machines get smarter, benchmarks must grow ...
"We made a mistake in not being more transparent": OpenAI secretly accessed benchmark data, raising questions about the AI model's supposedly "high scores" …
A new report suggests OpenAI secretly funded and accessed the FrontierMath benchmarking data, raising concerns about whether ...
Nature9d
How should we test AI for human-level intelligence? OpenAI’s o3 electrifies quest
The technology firm OpenAI made headlines last month when its latest experimental chatbot model, o3, achieved a high score on ...
‘Manipulative and disgraceful’: OpenAI’s critics seize on math benchmarking scandal
In this edition…Watch OpenAI’s hands; Trump scraps Biden’s AI order; Whistleblower targets Amazon and Covariant; Titans vs.