What I find is that a total lack of clouds can make the sunlight feel overly bright and intense. The dryness can also lead to a bit of dust in the air.
This is pretty minor nitpicking overall, but the middle of the day can feel a little harsh for these reasons. The landscapes also get dried out.
This is more noticeable in the south bay than SF and thereabouts