Scaling data is not always possible. It's really hard to get your hands on good labelled medical imaging data, for instance. Maybe it makes sense to try to incorporate insights from biology and physiological instead of hoping that the neural net will "get it" from seeing enough data.