My guess is that Linus doesn't care about large binary files.
Yeah I've read interviews where he's said that he wrote git for his use case, which I imagine doesn't include large binary files. I don't think he'd really care.
Linus has a family, and so pictures etc. So he should care. ;)