deep learning models have already been permitting "shallow signals" for a while. see "skip connections"

https://theaisummer.com/skip-connections/