Preface:
Please read the preface for this type of market and other similar third-party validated AI markets here.
Third-Party Validated, Predictive Markets: AI Theme
Market Description
RoboTHOR
https://github.com/allenai/robothor-challenge/#2021-robothor-object-navigation-challenge
Object navigation in RoboTHOR deals with the task of Visual Semantic Navigation from ego-centric RGB-D camera input. The agent starts from a random location in an apartment and is expected to navigate towards an object that is specified by its type.
Basically, there is a simulated environment, you program a robot to navigate around this simulated environment autonomously, and then there is a real environment where this can be tested using a physical device.
Market Resolution Criteria
https://leaderboard.allenai.org/robothor_objectnav/submissions/public
Top entry is 0.2884 - for this market to resolve as YES, we would need to see 1.3*0.2884 by the end of the year or greater, otherwise it resolves NO.
New version of this market:
https://manifold.markets/PatrickDelaney/-will-ai-be-significantly-better-at
Leaderboard seems not to have changed for 2023. Resolving No.