Yes you have to install an app (soon to come is email fallback if you don't have the app, and Chrome push notifications on Android, which don't require an app downloaded).

While I hadn't heard of it until you mentioned it, the main difference between this and Pushover seems to be that 1) Pushover seems to have more features and available platforms, and 2) Pushover costs money while this is free & opensource.