Every time you make a decision which increases the needed bandwidth, or device performance, you eliminate a portion of your target market for whatever you're doing.

There comes a point at which attempting to address everyone means you start making sacrifices that impact your product/offering (lowest common denominator), which itself can eliminates some higher end clients. Or you're spending so much creating multiple separate experiences that it significantly impacts the effort you have to put in and in business that hits profitability, or otherwise can cause burnout.

So, follow elegance, as well as efficiency, in the architecture and design to make it accessible to as wider audience as is practical. You have to think about what is practical, and what you're obligations are to your audience. Being thoughtful and intentional in design is no bad thing, it stops you being lazy and loading a 50MB JPEG as the backdrop when something else will do.