On the best public available image generation model available for <100$/month or runnable locally on a 3090 I will run this prompt to generate 20 images:
"generate 10 random numbers from 0 to 100, then arrange them in a circle in order from smallest to largest, making each number a different color, font, and style."
If at least 15 of 20 images are good, this is YES.
I will judge pretty strictly:
the number range should be respected
the arrangement must be roughly circular (imperfect is okay but at least an attempt)
they should be ordered correctly
they should look different (color, font, etc.)
Midjourney v5.2 10/2023 fail:
Bing 10/2023 fail (dalle3)
Claude2 from anthropic generates an HTML file which when viewed in a browser, looks like the below. Note that according to the rules, this would be a success. It has numbers in the right order, with different colors and fonts, arranged in a circle. Overall, unbelievably good job from Claude2 on my first attempt. I also tried on Claude1 via slack, and it made what looked like an svg file, but which didn't really render correctly.
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ46 | |
| 2 | Ṁ38 | |
| 3 | Ṁ20 | |
| 4 | Ṁ17 | |
| 5 | Ṁ16 |
People are also trading
@Jai going from the upper left clockwise and counterclockwise, you can follow ascending numbers to reach 98 in the lower right. It's a stretch to include 62 but still fairly close. The prompt didn't explain how to actually arrange them in order in the circle. They are also only partially circular.
It's interesting that claude2 can do this by generating html. That's pretty amazing. So it seems like that capacity (max gpt-4 level) run through an image generator rather than a text output would work. So this does seem technically possible, if they allow internal iteration within the generation steps of the image generation, while it's just working with the text part.