This line of thinking can and is used as an excuse for all sorts of security shortcomings. Yes, in threat modelling, this would be give fairly limited opportunity as an attack vector, but any successful attack could have a massive impact. It makes sense for device owners to consider this possibility in how they protect their machines, and for device manufacturers to attempt to mitigate it.