I always understood the main difference between CPU and GPU is that CPU's are specialised to handle branching, where GPUs are not.