Its a quite small influence, about 50 milliWatts per square meter iirc. Overall we are well insulated from heat circulating inside the Earth (by miles of rock) while hundreds of watts per square meter enters the atmosphere from solar radiation.