
Inspired by this xeet https://twitter.com/chheplo/status/1762169694516301944
How much time will pass between a non-OpenAI LLM being released (like Gemini, Mixtral, etc) that beats GPT4, and OpenAI releasing their next LLM (GPT4.5, or GPT5, etc)?
Only the largest answer without going over will be chosen. So no saying 1 second and expecting to get all the mana.
People are also trading
@BoydKane I think this should resolve to 1 month: EpochAI's ECI benchmark aggregate shows Claude 3 Opus beating GPT-4, and GPT-4 Turbo (Apr 2024) being realeased a little over a month later. If you think the performance gap it to small Claude 3.5 Sonnet would be the first to beat GPT-4, and GPT-4o mini was released less than one month later, but o1 a little over 2 months later.
@Johne5ee I assume it resolves if the next OpenAI LLM is released without a competitor beating GPT-4
@bohaska Correct intepretation, although I could have phrased it better. I'll see if I can add a clarification
@SarM I'm not the creator, but if I were, I would say Claude 3.5 Sonnet definitely beat GPT-4, and that o1 preview definitely beats Sonnet