I recently built a similar system for HackOHI/O, my college's hackathon. Was a great challenge! We used a slightly different approach, as we didn't have the time or expertise to train our own models.