In a significant move, Primate Labs unveiled Geekbench AI 1.0 on Thursday, a new application now accessible for users of Android, Linux, MacOS, and Windows. This application extends the renowned Geekbench benchmarking framework to incorporate evaluations for machine learning, deep learning, and additional AI-related tasks, aiming to harmonize assessment standards across different platforms. This initiative follows the Geekbench ML (machine learning) version, introduced in 2021, which is presently at version 0.6.
Primate Labs has observed a trend where businesses increasingly adopt the term ‘AI’ to describe these specific workloads and their associated promotional efforts. “In recognition of this shift and to ensure clarity and comprehension across the board — from engineering professionals to benchmarking aficionados — we believed it was pertinent to refresh our approach,” the company commented regarding the update.
Furthermore, earlier in the week, OpenAI, the creators behind ChatGPT, introduced a new measure for evaluating AI models named SWE-bench Verified. This innovative benchmark distinguishes itself by incorporating human judgment to accurately assess the effectiveness of AI solutions in addressing practical, real-world problems.
Compiled by Techarena.au.
Fanpage: TechArena.au
Watch more about AI – Artificial Intelligence
