I'm actually making exactly what you're looking for: https://moo.do

It does to-do lists, calendar, and email all in one. The only caveat is it only supports Google Calendar and Gmail so far.

Let me know if this solves your problem or if there's anything I can do to make it better for you.