Will I be impressed by the performance of LLMs on organic chemistry problems? | Manifold

Will I be impressed by the performance of LLMs on organic chemistry problems?

7

100Ṁ100

resolved Jun 7

Resolved

N/A

1H

6H

1D

1W

1M

ALL

I took an undergrad organic chemistry class shortly after ChatGPT came out. It was extremely bad at it. Now I am taking a graduate class in organic chemistry. I will be impressed if I cannot come up with a range of simple problems at which it fails. I do not expect it to be good at drawing or reading diagrams/structures, so will be super-impressed if it can, but do not require it.

I will only use the publicly available (possibly premium, but not the very expensive ones) LLMs. Resolves no later than start of June.

Get

1,000

to start trading!

People are also trading

Will the Noise Step paper work for LLMs?

Will an LLM get > 50% on hard problems on LiveCodeBench Pro?

Will LLMs be the best reasoning models on these dates?

Will LLMs be able to formally verify non-trivial programs by the end of 2025?

LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

Will an LLM agent complete >50% of the lab tasks on the Factorio Learning Environment benchmark in 2025?

Will LLMs be worse than human level at forecasting when they are superhuman at most things?

Will LLMs be used for academic peer review by 2030?

Related questions

Will the Noise Step paper work for LLMs?

Will an LLM get > 50% on hard problems on LiveCodeBench Pro?

Will LLMs be the best reasoning models on these dates?

Will LLMs be able to formally verify non-trivial programs by the end of 2025?

LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

Will an LLM agent complete >50% of the lab tasks on the Factorio Learning Environment benchmark in 2025?

Will LLMs be worse than human level at forecasting when they are superhuman at most things?

Will LLMs be used for academic peer review by 2030?

© Manifold Markets, Inc.•Terms•Privacy