Hacker News Reader

Comment by amirhirsch | Hacker News Reader

Same boat lol. Saw the open-source comments and decided to buy one so I could make a sheet-music reader that changes pages automatically using facial cues from an ESP32-CAM

View on HN

I'm slightly astonished (have been for a while) at the fact that no-one (as far as I know) have developed a Guitar Hero style e-ink sheet-music reader. Imagine how much easier you'd make life for kids learning how to play music! Software and hardware wise, it's got to be well within the realm of feasibility.

You should check out Rocksmith. Its guitar hero with real guitar, pretty cool stuff. I don't see how a scrolling format like guitar hero would fit the slow refresh rate of an e-ink display, but perhaps you imagine something different.

Absolutely love that toy, unfortunately they stopped producing DLCs for it some time ago to do something else... I wonder what that is.

Custom DLC is still going strong

They are working on RockSmith 2, you don't know this from me.

I remember a couple years ago getting Rocksmith for my ps4 and absolutely loving it. The controller mappings were a little unnatural in places but I did reasonably well with reading their notation/tab. Fast forward to when I tried to pick it up again a few weeks ago ... I can't read their notation/tab for the life of me. It's so confusing. Need to rewire my brain somehow.

Or Yousician. I'm not a fan of the Rocksmith presentation which relies on small position differences and colours, but there are alternatives.

I ordered my remarkable2 yesterday. Wrt sheet music, Not exactly what you were talking about but there was a great app called jammit that did something similar --playing along with sheet music with existing songs, and either isolating the instrument or muting it. The app just disappeared one day and the community reverse engineered the app and you can still get it under the facetious name "crammit" on Mac and windows. I found it very helpful to learn drum set notation.

The Kala Ukulele app is a chords only version of this. It also includes videos showing how to play each section, and it plays accompaniment into your headphones as you play along.

I found it super helpful, and I believe it's based on technology originally developed for teaching guitar.

Not sure if it's open for programming your own songs in or not, and much of the library is behind a paywall.

ePaper does not refresh fast enough to do the falling notes thing you are thinking of. An ipad works infinitely better, costs less second hand (I got an ipad air 2 dirt cheap and its still getting updates) and it does more.

Also my experience with using those things is that you would be better off spending the time to learn sheet music because once you get past twinkle twinkle little star, the falling note style videos don't work. You can't keep up with them live and paused they only show you the very short term future.

Yep, you might as well just learn to read music the traditional way. It's very common for musicians to be reading the sheet music a long way ahead of the actual music being played, especially while playing fast and complex pieces.

Having said that, an e-ink reader that could read visual cues would be awesome, but I feel it could be very frustrating unless it was incredibly smart. Maybe some kind of blink gestures might be useful.

I think the best UI would just be a page change foot pedal. Not particularly difficult to implement and very reliable.

That's what many big-name classical pianists use, a pedal hooked to an iPad.

Why iPad though? I’ve seen a specialized electronic music sheet (seemingly based on e-ink) in some videos, I guess pages are flipped using a pedal since I didn’t notice any visible interaction with it to do so, e.g. https://youtu.be/oB-gF2Ncphg

I think the question quickly becomes why not an iPad. They're easy and pretty cheap to get hold of, have good screens, lots of people can easily write new software for them and they're also a tablet. Many people may already have one and so using hardware they already have is much cheaper than buying new special hardware.

Also, eink screens are nice to look at but so expensive for non-kindle sizes.

I've played so much live music with an IPad, but after the 4-5th time having it freeze up mid live performance I gave up on the dream. It's just not 100% reliable, and nothing like standing there like an idiot desperately trying to swipe to the next page to make your realize how great paper is

that really sounds like the software you were using not the ipad itself. most people essentially NEVER have their ipads freeze.

chucking the ipad because of that is like chucking the baby out with the bathwater because the bathwater got cold. The baby still has value. you just replace the water.

cool video. looks like the remarkable, actually two of them. now i need to buy TWO

Probably because you could just make an application like that on an iPad...

Not sure about the Guitar Hero bit, but there’s a really nice, albeit very expensive, e-ink “sheet music” device. Product name is Gvido (not a typo). I’ve been using it professionally for about a year. Clunky UI, but hugely nicer than carting around books and sheet music. Form factor is more like traditional sheet music size than is an iPad, and it opens like a book—two side-by-side big, non-backlit pages. Turn pages with a Bluetooth pedal.

Thanks, link for convenience: https://www.gvidomusic.com/

you mean like this? not animated but up the same street. nothttps://www.padformusician.com/en/products/18-18-padmu-3.htm...

What a great idea! How can I learn if/when you build that music reader app?

Reply on news.ycombinator.com