It's not really that innovative. As the paper notes, there are several similar previous works. Also, it sounds like they have done a bunch of tweaking to reduce the "irreversible forgetting" specifically for this particular dataset and network, which is not very scientific. Further testing is required to see if this method really has legs.