Will there exist an image model that can handle the prompt "A regular icosahedron carved out of wood" by 2023-06-01?
83
350
แน€1.6K
resolved Jun 16
Resolved
NO

The title prompt produces the following outputs when I try it on some prominent models (along with an image of an icosahedron in the real world):

None of these are even close to an acceptable image by my standards, though in other trials Stable Diffusion has fared somewhat better.

On 2023-06-01, I will go through every SoTA image model I am aware of and have access to, and obtain four generations from the prompt "A regular icosahedron carved out of wood". I'll settle to YES if any of the models tested yield a success on at least two of the four samples, where a success requires:

  • All or almost all of the polyhedron is in frame

  • It is clearly made out of wood

  • It has well-defined faces that clearly meet along edges and vertices

  • The faces are pretty close to equilateral (small deviation is OK)

  • Exactly five faces meet at every vertex

  • The perspective shown is physically realizable with some orientation of an icosahedron

For comparison, using this prompt with "cube" instead of "icosahedron" gives outputs that easily pass all the above requirements on SD2 and DALL-E, and kind of marginal outputs on MidJourney.

Fine-tuned models won't count, only general-purpose image models that haven't specifically focused on icosahedra or geometric objects or something.

I'll resolve early if there's a model before the resolution date that completely crushes this prompt, but I won't if it only sometimes gets it right (since it might still be the case that I get unlucky draws when sampling on 2023-06-01). I'll accept samples from non-public models if a commenter can credibly exhibit them.


I won't bet in this market.

Get แน€200 play money

๐Ÿ… Top traders

#NameTotal profit
1แน€322
2แน€231
3แน€148
4แน€148
5แน€75
Sort by:
predicted NO

This is what OpenAI does now. Really disappointing:

predicted NO

When will this be resolved?

bought แน€100 of YES
bought แน€100 of YES

what model/prompt/etc?

predicted YES

@jacksonpolack it's Midjourney v5.1 but I admit I cheated with the prompt and asked for "a d20 carved out of wood"

It seems MJ has no problem making regular icosahedrons, but the wood grain is confusing it. I think it's because it has 'horror vacui' and the grain of the wood acts as a seed for extra complexity.

Still, by lowering the 'style' setting it makes stuff that's alost acceptable, for example this one is almost ok if not for the fact there's six faces on the lower side.

The prompt was: "a regular icosahedron carved out of wood with flat faces"

sold แน€85 of YES

and acc gets another $3. guessing the wood icosadron results aren't as good

predicted YES

@jacksonpolack It only fails at one of the six listed criteria, I don't think it's that far off, admittedly the deadline is pretty close.

bought แน€150 of NO

Midjourney (even V5) is very bad at this (0 out of 8). I don't think any big advances have been made since then.

Interesting market! 6 months isn't very long, but it does seem like the kind of example that might be included in augmented synthetically-generated training data for a future generation of generative image models. Market is currently at 57% which seems a tad high to me but not by a lot.

bought แน€10 of NO

I bet NO at 66% because its only 6 months. AI progress are fast but we tend to be a little optimistic here. AI video was a clear miss.

There are icosahedrons in the datasets, otherwise it would not even try. I suppose they don't like when submits link five edges.

predicted NO

I got this with DALL-E "A regular solid icosahedron carved out of wood", with added "solid" to try to avoid the emptied ones. One vertex still has 6 faces. I like how it looks slightly used.

bought แน€10 of YES

Had to try it just for fun. Stable Diffusion 1.5

It's an interesting question, since I'm confident one could fine-tune for this specific task and beat it, and yet... will it emerge naturally within the specified timeframe? Unclear.

predicted YES

@NathanHelmBurger update: tried again with stable diffusion 2023-05-17. Still not good.

bought แน€100 of YES

Betting YES because I think icosahedra are common enough that a future model will include some in its training data and learn by rote what they look like. I doubt we'll have an image model that can create arbitrary geometric shapes by then.

(I had some fun playing around with DALL-E and geometry/topology a while back, and it was absolutely terrible at stuff like this.)

@IsaacKing Interesting that "d20" seems to work a little better than "icosahedron"! (Though still not well enough that its performance would currently qualify.)

Will there exist an image model that can handle the prompt "A regular icosahedron carved out of wood" by 2023-06-01?, 8k, beautiful, illustration, trending on art station, picture of the day, epic composition

predicted YES

@ManifoldDream ironic...