Stars and planets radiate energy. Some of that energy is visible light, most is not. Energy affects people physically and psychologically. The bodies in our solar system follow predictable cycles. To think that we are not affected by energy that hits the planet at regular intervals is silly. Does it control all of human behavior and events? Obviously not, but it's not doing nothing.
That's why I can put them together. They work together to create an effect in society. Astrology and horoscope belong together and support each other. Doesn't matter if one of them is less random.
The aspects you described (stars, cellestial bodies, energy) directly refer to scientific concepts. Which I find hilarious. It totally didn't started like that.
Look at what you said: light, kinds of energy. It totally is a domesticated strain of an earlier belief that was much different. The very domesticated strain you defend still supports the general idea of things like horoscope (in social dynamics terms), but it has come a long way in becoming more secular.
I would say my first description (a less virulent strain is possible) is spot on.