Question will resolve 1 month after both models are released.

Llama 3 refers to whatever model/set of models is released by Meta and clearly intended as a replacement/upgrade for llama2. If for example they decide to rebrand their next set of models as "uber llama", that will still count.

Mistral 2 refers to whatever model/set of models is released by Mistral AI and clearly intended as a replacement/upgrade for the current open source Mistral model.

Unless both Meta and Mistral release a model by June 2024, this question will resolve ambiguously.

Answer will be determined based on chatbot arena leaderboard (https://chat.lmsys.org/)

Assuming llama3 and mistral2 come with multiple versions, will be based on the highest ranking version of each. For example in the case of llama2 vs mistral, this would mean comparing Llama-2-70b-chat with an elo of 1065 and Mistral-7B-Instruct-v0.1 with an elo of 1008.