In this article, we ask what GPU memory bandwidth is, and examine why it should be taken into consideration as one of the qualities an ML/DL expert should look for in a machine learning platform.