The performance boost you get from using a GPU is incredible.
You might as well say they're free to make monitors that don't rely on color.
GPU performance per dollar is only competitive for specific workloads. For extremely large scale compute, getting enough data center GPUs can also be challenging.