I am trying to get to a normative theory of fun.

Right now, it seems to me that generative AI, while enabling amazing creations and quick explorations (like me making a MTG proxy deck, Yudkowsky illustrating their story idea), also may suck fun out of creativity. I am undecided about it, because I am very wary of claims like "Working gives us meaning" which I do not endorse.

More generally, I am still unsure about what to tell a well-aligned AI what not to optimize. If I want it not to dictate who I should go talk to to have a better day? The cooperationist part of me wants to just say "Then I delegate to this AI and it is me", but it doesn't solve the question of what I would like to do once death has been eradicated and there is no more urgency and wrong in the world to be corrected.

This is all very related to Fun Theory. But everything I've read about it so far is extremely descriptive. I wonder if I can have the same approach to it that I have had with cooperationism: asking myself how I could have come to the concept of fun if I lived in the void.

So what does a utopia look like? What does fun look like, and what challenge do I want to impose on myself?