My observation is that you will make the biggest difference in your education. You will get out what you put in unless you are gifted.
Next difference is in-school opportunities, but this might be less important for a BS CS versus physics.
Don't ignore your non degree interests. They can make college life much better.