Git LFS is limited by your hosting solution. If you use Gitlab, for instance, your repository cannot exceed 10 Gb of storage space (including code and other ressources). And on Github I believe that limit is 1 Gb.

Many Deep Learning datasets that deal with pixel-data grow past the 10 Gb mark.