Will an open source model beat any gpt-4 in eq-bench by the end of February 2024?

Basic

32

Ṁ3200

resolved Mar 6

Resolved

YES

1D

1W

1M

ALL

I will benchmark it myself.

Here, open source means weights publicly available regardless of license.

This question is managed and resolved by Manifold.

#Technical AI Timelines

#GPT-4 speculation

Get

1,000

and

3.00

🏅 Top traders

#	Name	Total profit
1		Ṁ75
2		Ṁ31
3		Ṁ30
4		Ṁ19
5		Ṁ13

Sort by:

See https://eqbench.com/

ShinojiResearch/Senku-70B-Full scores higher on EQ-Bench than gpt-4-0613 and gpt-4-0125-preview as per eqbench.com

should a model based on leaked mistral weights count as open? Market description seems to imply yes.

Can someone benchmark this https://huggingface.co/axra/miqu-120b

Related questions

Will an open source model beat GPT-4 in 2024?

Will we have an open-source model that is equivalent GPT-4 by end of 2025?

Will a single model running on a single consumer GPU (<1.5k 2020 USD) outperform GPT-3 175B on all benchmarks in the original paper by 2025?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will there be an open source LLM as good as GPT4 by June 2024?

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

Will an uncensored open-source LLM model comparable to 2023 GPT4 be available to the public by the end of 2025?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

Related questions

Will an open source model beat GPT-4 in 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will we have an open-source model that is equivalent GPT-4 by end of 2025?

Will there be an open source LLM as good as GPT4 by June 2024?

Will a single model running on a single consumer GPU (<1.5k 2020 USD) outperform GPT-3 175B on all benchmarks in the original paper by 2025?

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

Will an uncensored open-source LLM model comparable to 2023 GPT4 be available to the public by the end of 2025?

Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?

In what year will a GPT4-equivalent model be able to run on consumer hardware?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules