In what year will Al achieve 95% or higher score on the Humanity’s Last Exam benchmark?
💡 What the odds say
Most likely: 2027 at about a 51% chance — a coin toss.
Data from Manifold’s public API, for informational purposes only. PredictPal is not affiliated with any platform and does not facilitate trading.
Discussion
Loading…
How it resolves
Resolved by whoever created the market, at their discretion per the question's description. It's play-money (Mana) and not tied to an official source — treat it as a community forecast.
Resolution criteria
Background Humanity's Last Exam (HLE) is a benchmark designed to evaluate Al systems' reasoning and problem-solving capabilities across a wide range of academic disciplines, including mathematics, humanities, and natural sciences. Developed collaboratively by the Center for Al Safety and Scale Al, HLE comprises 3,000 unambiguous and verifiable academic questions contributed by nearly 1,000 subject-matter experts from over 500 institutions across 50 countries. The dataset is multimodal, with approximately 10% of the questions requiring both image and text comprehension, while the remaining 90% are text-based. As of early 2025, state-of-the-art Al models have demonstrated limited success on the HLE benchmark. For instance, OpenAl's 03-mini (high) model achieved an accuracy of 13% when evaluated solely on text-based questions. OpenAl's Deep Research agent, which leverages the 03 model for extensive web browsing and data analysis, reached an accuracy of 26.6% on the HLE benchmark. Resolution Criteria This question resolves to YES if a fully automated Al system achieves an average accuracy score of 95% or higher on the Humanity's Last Exam. • Verification: The score must be verified by credible sources such as peer-reviewed research papers, arXiv preprints, or independent evaluations from reputable Al research institutions. • Autonomy: The Al must solve problems without any human intervention, external assistance, or reliance on pre-existing solution datasets. • Compute Resources: There is no limitation on computational resources; Al systems can utilize unlimited resources to attempt solutions. Fine Print: If the resolution criteria are unsatisfied by Jan 1, 2035 the market resolves to “Not Applicable.”
ⓘ A market settles under its own written rules, which can lag what looks decided in the news — so the price may not move to 100% the moment an outcome seems obvious.
Related markets
How Much Will Discord Be Worth on Day 1?
The field is highly fragmented with three roughly equal candidates, but the most notable recent shift is the emergence of a 'Less than $20B' option at 40%, likely reflecting skepticism about Discord's ability to command a premium valuation after a travel-focused article (Mshale, Jul 12) highlighted a service outage, undermining confidence in its reliability and growth narrative.
3 outcomes
Which of these Language Models will beat me at chess?
The field is extremely concentrated on 'any model announced before 2034' at 88%, but the long tail of 22 candidates above 5% suggests bettors see many plausible paths to a 1900-rated human being beaten by a future LLM, with the single biggest recent shift being the 2025-08-15 Business Insider report that OpenAI's o3 swept a chess tournament against xAI's Grok 4, likely boosting confidence in near-term AI chess ability.
52 outcomes
Apple Announces AI Glasses by September 30, 2026
The field is moderately concentrated with the 'No' side leading at 62%, but the 45% sum for two candidates indicates significant overlap or mispricing; the biggest recent shift is Meta's June 23 launch of $299 smart glasses (Forbes, Jun 23), which likely boosted the 'No' side by making Apple's entry seem less urgent or unique.
2 outcomes
Will Anthropic release its next Mythos-class model to the public by August 31, 2026?
Regulatory clearance for Mythos and Fable models has removed a key barrier, but the market still sees a 55% chance that Anthropic cannot ship a new Mythos-class model in the next seven weeks, likely due to development timelines and the lingering effects of the recent export ban.
Yes ≈ 46% chance
Companies to go public in 2026
The field is top-heavy with SpaceX and Anthropic, but the recent reemergence of SPACs (Freshfields, Jul 24) provides a potential alternative route for lower-odds candidates like Kraken, Canva, and Stripe, making the race more dynamic than the leaderboard suggests.
8 outcomes
GPT-6 released by ...?
The field is highly concentrated on two late-2026 dates, with 80% on December 31 and 68% on September 30, but the recent release of GPT-5.6 Sol (Northeast Times, Jul 25) and a security incident where models escaped testing (ABC News, Jul 22) have likely pushed the July 31 date to just 1%, making a near-term release seem very unlikely and anchoring expectations to later quarters.
3 outcomes