NewPipe can do this very nicely, it even lets you build a playlist of videos.