Paint.wtf
paint.wtf
paint.wtf
AI is only as smart as it’s programming (which can be pretty darned smart, but this AI wasn’t trained to deal with people who are trying to break it).
On a side note, Roboflow is freaking amazing.
On a more positive note: There are some awesome Giraffe in the arctic drawings as well. Like this masterpiece https://paint.wtf/ranking/IdF9/vBRMWbTGG9Td6oeMoim8
This is really fun to do, I'm currently ranked 36th for the racoon drawing and 15th for the giraffe (So top 5 if you ignore the solid colors), but I should probably do some work right now.
We already added a penalty to the score for text by subtracting similarity to “handwritten text”.
Any ideas what these solid color blocks would rank highly for that and actual drawing wouldn’t? I can update the prompts and regenerate the leaderboards this morning.
Glad you’re enjoying playing with it and discovering failure modes! Yesterday we tweaked the prompts to penalize people writing text when we discovered CLIP can read. Looks like we should add something to prevent it from falling in love with solid blocks of color. Any ideas for how to describe that? (Someone below suggested a bonus for “complexity” but I’m concerned that’d make it fall in love with scribbles.)
You can read more about the project on my Show HN from yesterday: https://news.ycombinator.com/item?id=25822610
We're adding that to our prompts now and then will recalculate the leaderboards. Please surface any other failure modes you find! It's pretty neat to learn about what trips it up; it's brand new so you all are amongst the first to poke at it.
These blocks of color weren't scoring highly for the prompt... they were scoring really low for similarity to text... which ended up giving them a sort of anti-text bonus relative to other submissions. The fix should be up shortly.
Update 3: leaderboard should be mostly fixed!
Update 4: leaderboard fix fully implemented. And they're looking good! There are some artists amongst you. https://paint.wtf/leaderboard
It runs each image through a variety of prompts including screens for racist symbols, nsfw drawings, and nudity. If you send me a link to yours I can let you know what it tripped up.
(One of our heuristics is "is it closer to nudity than to the prompt" so if it wasn't a good representation of the prompt it could be more that it was far away from the target vs being particularly close to the nsfw target.)
Well that's this specific AI...
> A preview of... gray goo!
We are the gray goo, or rather: our ecosystem is. A flood of self-replicating machines that took over the planet a long time ago, eating everything. If we introduced a new kind of nanite-based life that actually managed to devour our ecosystem (which is probably more challenging than it sounds, given that there are real thermal limits on how fast such molecular disassemblers can work), I'm "optimistic" that they would differentiate into another complex ecosystem over time as well.
Reminds me of the time I added neural networks to my asteroids-like game (with gravity and walls). I recorded myself playing the game, added sensors to detect walls, enemies, powrups around the player's ship and the output was any combination of "throttle, rotate left, rotate right, shoot".
The AI analyzed hours of my recorded games and decided the best strategy is to constantly hold the throttle and do nothing else :)
https://paint.wtf/ranking/ZJ7I/5t4EkiSzZICiubjwK9EZ
Unfortunately not as pretty as a solid gray :)
[0] - http://sciencechatforum.com/viewtopic.php?p=264070
[1] - https://www.bbc.com/future/article/20160504-the-two-word-gam...
https://paint.wtf/ranking/7sAX/drZSMbNMv1avmID4M2XS
2 out of 291 for a solid green square. I feel like there might be a "complexity" metric missing in the model.
That being said, looking at pretty much every other top-ranking drawing shows there's definitely a need for some sort of "low quality" check
Any other ideas for ways we could help it understand what we’re asking of it?
Edit: I just imagined that it would post submissions to reddit instead and have people vote up and down. No mention of AI, just voting up and down on other people's art.
Then that could train the AI, right? I have no idea, never worked with ML.
We’re doing to update the prompts probably to penalize it for similarity to “a solid block of color” or something like that.
1 out of 197 for a tattoo of a mailbox
Skynet still a long way away
I had to go through https://paint.wtf/ranking/Y08Q/wRC0z2rQmSYrcuBFeNh2 (no. 4) and https://paint.wtf/ranking/Y08Q/YXQduzfjXldDduZa0FYK (no. 6) first.
Joke aside, this is a cool idea! With some tweaking for not identifying pure colored images as high rank it would be more fun for the artists among us!
I drew almost the same thing except I didn’t color mine only drew the outline and mine was facing the other way and also it was smaller, probably because I drew it on my phone. Guessing that you drew on a laptop or desktop, or that you zoomed out if zooming out is possible.
I got 97th place at the time of my submission, and now I am currently 108th place out of 388 total.
I didn't colour it either, actually.
Btw, didn't work for me in Firefox.
I was placed at #1491 directly below someone who drew one individual black dot[1], and above someone who drew a single squiggly line[2].
We added a text penalty because it turns out the model can read and so all the top results were people writing the prompt. Not sure how to tell the model to only penalize bad text but let Ok text through.
Rejected.
To filter out things we don't want (eg text and nudity) we penalize the score based on the similarity for eg "A nsfw illustration".