There is no way an attention network is that good.

• 1 hour video understanding

• Needle in a Haystack 99% accuracy

• Learning a language that no one speaks by reading a grammar book "in context"

Resolves YES if we later found out that the long context ability was enhanced by agents/retrieval/search/etc., i.e. it was not achieved merely by extending attention mechanism.

Resolves NA if I can't find out by EOY 2024