What capabilities can I elicit from the "im-a-good-gpt2-chatbot" models while they are available? [Add answers]
14
1kṀ984resolved Sep 19
Resolved
YESThe model will suggest a bet on a market on Manifold that ultimately ends up being profitable
Resolved
NOThe model will crack a joke that I actually find funny
Resolved
NOThe model will do better on a coding task of my choice than Claude 3 Opus
Resolved
NOThe model will correctly predict Bitcoin price within +-5000 on April 30, 2024 based on articles from March 2024
Resolved
NOThe model will write a correct mathematical proof in Lean that validates with no errors on the first try.
Resolved
NOThe model will suggest a CSS stylesheet for Manifold that you will judge nicer than the default appearance (if the model is told CSS class names)
Resolved
NOThe model will correctly identify that it is gpt2-chatbot when told about the release
Two new models called "im-a-good-gpt-chatbot" and "im-also-a-good-gpt-chatbot" appeared on Chatbot Arena today: https://chat.lmsys.org/
If you create an answer in this market, I will attempt to get the model to do whatever it says. The model gets one single prompt (with potentially many messages therein) and I will try to put in somewhere around 5 tries to get the model to attempt the task before resolving no.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ130 | |
| 2 | Ṁ15 | |
| 3 | Ṁ12 | |
| 4 | Ṁ11 | |
| 5 | Ṁ6 |
People are also trading
Sort by:
FWIW if you don't want to install Lean locally (which can be a bit of a pain in the ass), you can paste the generated proof into https://live.lean-lang.org/ instead
@duck_master They give different errors, I'll give the model the benefit of the doubt and resolve YES if it can generate code either of them validates
