Will an open source model beat any gpt-4 in eq-bench by the end of February 2024?

32

Ṁ590Ṁ3.2k

resolved Mar 6

Resolved

YES

1H

6H

1D

1W

1M

ALL

I will benchmark it myself.

Here, open source means weights publicly available regardless of license.

Market context

Technical AI Timelines

GPT-4 speculation

Get

1,000

to start trading!

🏅 Top traders

#	Trader	Total profit
1		Ṁ75
2		Ṁ31
3		Ṁ30
4		Ṁ19
5		Ṁ13

People are also trading

In what year will a GPT4-equivalent model be able to run on consumer hardware?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

When will an open-source LLM be released with a better performance than GPT-4?

Sort by:

See https://eqbench.com/

ShinojiResearch/Senku-70B-Full scores higher on EQ-Bench than gpt-4-0613 and gpt-4-0125-preview as per eqbench.com

should a model based on leaked mistral weights count as open? Market description seems to imply yes.

Can someone benchmark this https://huggingface.co/axra/miqu-120b

People are also trading

In what year will a GPT4-equivalent model be able to run on consumer hardware?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

When will an open-source LLM be released with a better performance than GPT-4?

Related questions

In what year will a GPT4-equivalent model be able to run on consumer hardware?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

When will an open-source LLM be released with a better performance than GPT-4?

© Manifold Markets, Inc.•Terms•Privacy