Preface:

Please read the preface for this type of market and other similar third-party validated AI markets here.

Third-Party Validated, Predictive Markets: AI Theme

Market Description

AI2-THOR Rearrangement Challenge

This question pertains to the following AI challenge:

https://github.com/allenai/ai2thor-rearrangement#----2022-ai2-thor-rearrangement-challenge

• The goal of this challenge is to build a model/agent that move objects in a room to restore them to a given initial configuration.

• Example query:

task involves moving and modifying (i.e. opening/closing) randomly placed objects within a room to obtain a goal configuration. There are 2 phases:

1. Walkthrough 👀. The agent walks around the room and observes the objects in their ideal goal state.

2. Unshuffle 🏋. After the walkthrough phase, we randomly change between 1 to 5 objects in the room. The agent's goal is to identify which objects have changed and reset those objects to their state from the walkthrough phase. Changes to an object's state may include changes to its position, orientation, or openness.

The resolution for this market will be here:

https://leaderboard.allenai.org/ithor_rearrangement_1phase_2022/submissions/public

Market Resolution Threshold:

• If any 2022 AI2-THOR Rearrangement Challenge Submission Get a % Fixed Strict (Test) Score of >0.4 by end of 2023, this resolves as YES, otherwise NO.

Mar 22, 12:25pm: Will Any 2022 AI2-THOR Rearrangement Challenge Submission Get a % Fixed Strict (Test) Score of >0.4 by end of 2023? → Will AI Achieve Significantly More, "Embodiment" by end of 2023?