GAIA: a benchmark for General AI Assistants was introduced in Nov. 2023. It contains task for AI agents that test there ability.

An example task is:
"Assuming scientists in the famous youtube video The Thinking Machine (Artificial Intelligence in the 1960s) were interviewed the same year, what is the name of the scientist predicting the sooner thinking machines or robots? Answer using the format First name Last name"

Currently the strongest AI system like GPT4 with plugins or AutoGPT failed to solve any of the level 3 task. This market will resolve to "yes" as soon as an AI/Agent system scores >=40% on level 3 tasks.