Hacker News Reader

Comment by comboy | Hacker News Reader

Btw, Merlin Bird ID app by Cornell University is so good that I got some people interested that weren't into that topic at all.

View on HN

Merlin's story is very interesting: https://www.birds.cornell.edu/home/the-magic-of-merlin/

The journey to a magical, free bird sound ID app involves some obvious steps (the NSF gave them money), but the amount of timeline offramps is really high. The NSF didn't think this app was educational ("it's just telling them the answer, they don't even have to work for it!"), the funding ran out so they were thinking of charging money, eBird happened to have five years of bird sound recordings they could use, a computer vision guy on the team happened to learn that spectrograms are basically the same as pictures...

And the result is tremendously useful! They get great signal on where birds are, and they're making people so much more interested in birds and nature and science. And I think charging $1 for the app or, shudder, some sort of subscription model might've ruined the whole thing.

Funnily enough I was in the bathroom (that's where I do my most random thinking) just yesterday evening thinking how template matching in computer vision, e.g. https://docs.opencv.org/5.0/py_tutorials/py_imgproc/py_templ... is basically audio signal processing but instead of being temporal it is spatial. Different signals but same principle.

I call it Pokemon Go for grown ups. How many do you have in your life list? I finally managed to snag a Tawny Owl last week.

I've got 33. I don't know how that stacks up against other but a large percentage of them came just from my backyard. Just got added a Baltimore Oriole that showed up this week.

I'm up to 71 thanks to the joys of taking it on holiday to other countries (less joy for my family), and occasionally going places just because I know there'll be new birds there.

Personal best for a single session is 23 birds in my back garden over the course of a couple of coffees. I have though spent a fair bit of time making the garden as attractive to different types of bird as possible - mainly through having a variety of different shaped feeders with different feed in. I can recommend the NatureSpy camera feeder too [0] - though I have had to modify it a little to make the food hole smaller otherwise magpies empty the thing in a single day just chucking all the seed on the floor. Dickheads.

[0] https://naturespy.org/collections/wifi-solar-bird-feeder-nes...

I've only been birdwatching since spring and I got 28 species already. Lots of seabirds because I spend a lot of the time at the beach.

Tawny owls make so many different noises. The classic sound is two, one calls and one answers but they are very chatty with different sounds. They live all around, but never seen one.

But a warning for novice birders: Merlin's sound ID feature produces a lot of false positives.

I've not seen this personally, but maybe it's region specific.

Merlin got me into birding, and I've found this to be true, at least in some regions, especially if there's lots of background noise.

Unless a species has a really, really unique call or song, I've made it my personal rule to get eyes on it and, if I'm still not convinced, to take a picture and cross reference with iNaturalist and what folks on there think of it.

I've learned to curse the species that differ from others by the sheen of the backs of the males' necks or the angle of a wingbar. Also, gulls that only differ by things like the color of their feet or beaks.

You can usually tell, though. Rare birds in the wrong place or time that come up only once are problematic, but if the bird is detected repeatedly there's a better chance. You should also be on the lookout for birds that mimic other birds (like the northern mockingbird and the gray catbird.)

Cornell / Merlin / eBird publishes a global species frequency DB indexed by location and date (so, how likely is a species to appear in a place, on a day of the year)... In a project that I was working on, this helped a lot when used to influence the "raw" identification based on appearance alone.

For info, there's a FOSS bird-call app, available on F-Droid, that's pretty decent: WhoBird

Occasionally I'll see a screenshot of Merlin with, I dunno, a dozen different birds, and in the middle of the list: a catbird. I never have the heart to tell people that they just heard one very creative bird.

For me, mostly a lot of false negatives. I have a Pixel 8, and I have no problems using the microphone normally, but somehow, Merlin requires the bird to be within a couple of meters of me and sing for quite a while before Merlin will even say “hearing a bird”. And of course, you have to be dead silent; if anyone talks or coughs, it will mess up the spectogram badly.

Given that it's colloquially “Shazam for birds” and Shazam is just amazingly resistant to noise, it's a bit disappointing :-)

I think what makes Shazam magically "just work" is that they are searching for the exact embedding of the recorded version of the song - it doesn't work for a cover version, acapella, etc even if it is very similar. (Everyone would want an app that you can hum into and it will ID the song, but I guess it's a very tough problem.)

Merlin is solving the more general problem so makes sense that it's much more finicky and less accurate.

> an app that you can hum into and it will ID the song

YouTube Music and Google Search do OK with these types. Sometimes if I know a song well enough, I will open YT Music, activate the mic search, and sing a few bars, instead of typing the song title.

According to Gemini, SoundHound is also a good app for song-hummers to try.

Still, we're talking orders of magnitude here. I've fed Shazam with a stream of the cheapest lapel microphone you could get, mounted behind a rack filled with twelve very noisy servers, in a hall filled with 5000 people also all being noisy, and it would reliably recognize music from the other side of that hall before I could do so myself (I had to walk halfway there to hear “oh, yes, it's actually right”). And that's on a stream encoded with 9600bps GSM compression. With Merlin, I can hold out my phone on a silent day, hear the bird loud and clear and it will hardly register.

Shazam primarily identifies on the geometry of spectogram peaks, FWIW (I wrote my master's thesis on the DSP of music recognition back in the day; it's possible that they are doing something more fancy now, of course, but I'm not sure if they would want to). I don't know exactly what Merlin is doing.

I'm not sure why but this seems very phone dependent. I can stand next to another person, both running Merlin in silence, and mine will pick up much more than some people's phones. My phone is not particularly new (Zenfone 8).

Indeed - background noise will tend to lead to a lot more false positives, but you should use it as a guide rather than inherently trusting results. Same goes for using BirdNET-go and other models, though these do allow you to be very strict with detections and reduce false positives more.

Indeed. I use Merlin Bird ID all the time. I found it good across many countries.

Listers: A Glimpse into Extreme Birdwatching

https://www.youtube.com/watch?v=zl-wAqplQAo

Love that documentary.

Btw the btw Merlin ID and OP's Birdnet uses the same model

Reply on news.ycombinator.com