Start date: April 9 , 2024

End date: April 9, 2026

Market with a shorter timeline:

inspired from this tweet by Andrej Karpathy:

Btw writing the llm.c training code would imo be a very interesting, impressive, self-contained and very meta challenge for LLM agents.

The prompt is: Take the PyTorch code train_gpt2.py And write, compile and unit test a single .c file that reproduces the training: train_gpt2.c

The current models are not there, but we can check back in a year or two or so. If that worked...