Show HN: Stowbots – Sort image downloads automatically using deep learning | Hacker News Reader

Show HN: Stowbots – Sort image downloads automatically using deep learning

stowbots.com

22 pointsnlowell19 comments

I'll be here in the comments if there are any questions. Thanks for checking it out!

What categories has the thing been trained on?

I assume you need a fairly extensive training dataset to train a net, and that would limit your ability to provide a net trained for arbitrary tags.

I gather new images based on what users request.

So I've apparently "ordered" a bot. What does that mean?

Normally it means that my server would be in the process of training a neural network which would get sent to you. Did you specify categories? I see a request that was just empty, which was dropped by the server as looking like a fake request.

How do I specify categories? There's a free-form text input field. Am I supposed to put stuff there? What do I put there? What works?

For that matter, I have multiple empty requests bots (apparently). How do you delete them? I could probably edit stowbotlist.json but I can't imagine that's the intended interface.

Yeah each free form text entry field becomes both a image category and a new folder that images will get sorted into. If you need to clear out the empty bots you can just delete the contents of stowbotlist.json. There will be a cleaner interface eventually but this tool is very new and still a little rough around the edges, especially in those cases where things go wrong. The demo video on the website shows an example of things you can request and how it would work.

Yeah, from the video (videos for text? Really?) you have some categories, but the point is what is the available space of categories?

Do you specify tags you want to filter by? For example, if I wanted to do (random suggestion) SMT IC package identification, how would I do that?

------

From the sound of it, right now, it sounds like you review the requested categories, and manually/semi-manually generate each specific network?

------

I'm basically in a position where it'd be much more valuable to me to have a thing I can point at a directory and have it tell me what it found then something I have to say "sort into these categories".

In general, there's very few cases where I have a dataset where I want to filter by a specific content, and don't already have that metadata. Content discovery would be much more useful.

Oh, also, you left your entire git tree in there, so I'm not sure if you meant to ship your entire codebase as well as a binary, but you did.

Hey thanks yeah. Working on the code cleanliness to be honest.

FWIW, this is a project I'm REALLY interested in. If you go open source, I'd totally get involved.

I have a mirror of *booru image galleries (basically, anime/manga images, but REALLY well tagged: upwards of 20+ tags per image) that I've been occationally meaning to see if I can turn into a google-deep-dream-like nightmare to make the worst hentai possible (it started as the idea for a terrible idea hackathon[1]).

I have a fair bit of experience writing web-scrapers [2], but no idea what I'm doing with neural net stuff. I keep meaning to spend time to figure out how to do anything, but other projects (and work) keep me distracted.

Anyways, if you have any use for 5496863 images (probably mostly hentai) with 196852748 tags, hit me up.

Or you could just run the scraper [3] yourself, but I hope you have ~5+ TB of free disk space.

1: http://www.stupidhackathon.com/ 2: https://github.com/fake-name 3: https://github.com/fake-name/DanbooruScraper

Thanks for the offer, but I'm not really interested in open sourcing this. I'm familiar with the danbooru set from Gwern's posts about it but I don't really intend to use it for anything.

Yeah, it's kind of specific to a certain weirdo subgroup (ayo~!!).

I've also chatted with Gwern a bit about the project. We had similar interests.

My scraper wound up being very similar to what he implemented, though it was already up and running when he made his first posts (I started my project about 6 months before Gwern).

The beta is available now and I'm sending out copies to anyone who signs up!

thanks for saving my desktop!

Reply on news.ycombinator.com