For a rough sketch, the following are some precedent models that may be what parts of this end up looking like.

MuZero by DeepMind

World Models by Ha&Schmidhüber

SHIFTT by DeepMind (Felix Hill specifically, hard to Google for) and the model from the later paper by the same author

Dreamer by DeepMind

@CarterHinsley This would also agree with some foreshadowing Demis Hassabis has done about later coming versions of Gemini -- he mentioned the AlphaGo family of models, which MuZero is the last one of. It is also the only one that has what you would consider 'internal thought.'

@CarterHinsley The others in the family of models do not really have designs that seem to me like they would work in an LMM.