Hacker News Reader

Comment by yeldarb | Hacker News Reader

CreateML is getting really impressive. I just went through the process of using it to train an Object Detection model to detect sharks and fish at an aquarium (and deploying the model to an iPhone) last week.

Final result: https://twitter.com/braddwyer/status/1330654868839784451

The full walkthrough video: https://www.youtube.com/watch?v=kBn7Cd8Z8yE

View on HN

Do you think it would be possible to detect the species of shark? I was thinking about trying to detect what breed of dog or maybe species of fish someone caught.

It's possible but you'd need more training data IMHO the more similar things get.

Could probably detect if it was a hotdog or not hotdog.

this might be a vc-case!

Train it, then test it on https://www.reddit.com/r/hotdogsorlegs/.

With the right training data, definitely.

Check out the Oxford Pets dataset as a starting point (you can download in Create ML format from here): https://public.roboflow.com/object-detection/oxford-pets

That's really neat. Once your model is complete, does it work offline?

Yep, in this example the weights are compiled into the app and inference is done locally on the iPhone processor.

Is the app available anywhere? I'd love to see if it works on my aquarium.

I didn't clean it up and submit for app review but if you have XCode you can compile and run it by tweaking the sample app (start at 22:25 in the YouTube video above).

Here are the weights: https://www.dropbox.com/s/c49a5zqqt1ml89o/Aquarium%202.mlmod...

What apps do you use for drawing the labeling/bounding boxes?

There are a handful of free tools you can use. We have write-ups of most of them in the "Labeling Your Images Yourself" section here: https://blog.roboflow.com/object-detection/

Roboflow (our startup) can import the annotation files from all of those tools and convert them to Create ML's format for you.

Reply on news.ycombinator.com