Will AI be able to write, compile, and unit test a single .c file to reproduce GPT-2 training from PyTorch code by 2026?
32
Ṁ1kṀ2kApr 9
25%
chance
1H
6H
1D
1W
1M
ALL
Start date: April 9 , 2024
End date: April 9, 2026
Market with a shorter timeline:
inspired from this tweet by Andrej Karpathy:
Btw writing the llm.c training code would imo be a very interesting, impressive, self-contained and very meta challenge for LLM agents.
The prompt is: Take the PyTorch code train_gpt2.py And write, compile and unit test a single .c file that reproduces the training: train_gpt2.c
The current models are not there, but we can check back in a year or two or so. If that worked...
This question is managed and resolved by Manifold.
Market context
Get
1,000 to start trading!
People are also trading
Will we fully interpret a GPT-2 level language model by 2028?
21% chance
Will $10,000 worth of AI hardware be able to train a GPT-3 equivalent model in under 1 hour, by EOY 2027?
16% chance
Will AI pass the Rube Goldberg Turing test by the end of 2028?
38% chance
Before 2028, will anyone train a GPT-4-level model in a minute?
29% chance
Will an AI system similar to Auto-GPT make a successful attempt to kill a human by 2030?
27% chance
GPT-Zero: By 2030, will anyone develop an AI with a massive GPT-like knowledge base that it taught itself?
33% chance
Will it be possible to disentangle most of the features learned by a model comparable to GPT-2 this decade?
89% chance
Will an AI be able to write a passable novel before 2028?
67% chance
By 2030, can we convert at least 10% of an AI's weights to C code, enhancing interpretability?
40% chance
Will AI pass Video Turing Test by 2030?
68% chance
Sort by:
@MalachiteEagle
> It straight up one-shotted it
> idk if the implementation is correct
Many such cases
People are also trading
Related questions
Will we fully interpret a GPT-2 level language model by 2028?
21% chance
Will $10,000 worth of AI hardware be able to train a GPT-3 equivalent model in under 1 hour, by EOY 2027?
16% chance
Will AI pass the Rube Goldberg Turing test by the end of 2028?
38% chance
Before 2028, will anyone train a GPT-4-level model in a minute?
29% chance
Will an AI system similar to Auto-GPT make a successful attempt to kill a human by 2030?
27% chance
GPT-Zero: By 2030, will anyone develop an AI with a massive GPT-like knowledge base that it taught itself?
33% chance
Will it be possible to disentangle most of the features learned by a model comparable to GPT-2 this decade?
89% chance
Will an AI be able to write a passable novel before 2028?
67% chance
By 2030, can we convert at least 10% of an AI's weights to C code, enhancing interpretability?
40% chance
Will AI pass Video Turing Test by 2030?
68% chance