It could be. A well insulated home requires cooling of some sort to stay cool or it will heat up, as it contains heat sources and is well insulated. That gets harder as the outside temperature rises. This has nothing to do with the colour of the building, though. And it's not something you can ease by removing the insulation – that actually makes it worse as now the high outside temperature might just make the inside temperature even higher.