Will Llama 3 405B match or surpass release-time GPT 4 on vibebench?
Basic
11
2.1k
resolved Aug 31
Resolved
YES

The public basically never got a full picture of GPT4 capabilities. As a result of quantization/distillation/expert routing tricks speeding it up, plus whatever safety ablations got applied, it's common consensus that March 2023 GPT4 and whatever Microsoft exposed via Sydney-era Bing was significantly better than what's accessible today.

This market resolves based on people's Twitter/Discord vibes comparing 405B (instruct or base) against what they remember from then.

Get Ṁ1,000 play money

🏅 Top traders

#NameTotal profit
1Ṁ423
2Ṁ162
3Ṁ88
4Ṁ11
5Ṁ11
Sort by:

https://x.com/repligate/status/1824179931057930617
Hermes-405B finetune in particular seems to have hit the same category of weird as Sydney did.