Will more than 5% of GPT-4’s training data be YouTube transcripts?
AIGPT-4 speculationNew Year's Resolutions 2024
Basic
34
Ṁ3.6k
Jun 2
11%
chance

If there is an estimate as to what the training data of GPT-4, this market will resolve to YES if more than 5% of it contains YouTube transcripts. Raw YouTube videos don't count towards the resolution, if GPT-4 ends up being multimodal.

Get Ṁ600 play money

Related questions

5 Comments
31 Holders
57 Trades
Sort by:

@BionicD0LPH1N how will this resolve if the information is not publicly available? How long will you you wait for it to become available (I expect likely it never will)? is the current close date a deadline?

How would you expect to prove this either way if the training data is at least partially a trade secret?

Useful: https://arxiv.org/abs/2101.00027 includes

youtube transcripts

The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Recent work has demonstrated that increased training dataset diversity improves general cross-domain knowledge and downstream generalization capability for large-scale language models. With this in mind, we present \textit{the Pile}: an 825 GiB English text corpus targeted at training large-scale la…
predicts YES

@tftftftftftftftftftftftf True, but only 0.6% of the dataset.

Will more than 5% of GPT-4’s training data be YouTube transcripts?, 8k, beautiful, illustration, trending on art station, picture of the day, epic composition

Related questions