The Incas apparently did not fight at night.
And why they did not managed to kill the horses, were likely because they were too afraid of them and they were not used to killing large animals as none existed there.
Otherwise all it takes to stop a knight on a horse is to kill the horse. Or just hurt its legs enough, or make it stumble.