AGPL isn't viral or contagious, it's copyleft. You need permission from the author to copy. If you violate the license terms you're copying something you're not allowed to copy. That's a copyright violation like illegally downloading music and the rights holder is allowed to tell you to stop doing it.