OpenAI Newly Released SimpleQA Helps Reveal That Generative AI Blatantly And Alarmingly Overstates What It Knows

OpenAI released SimpleQA, a new benchmark for generative AI. During the work, they uncovered a serious qualm about AI being supremely overconfident. Here's the scoop.