I think the role of cavalry charges for breaking infantry is commonly overrated; from what I have read, the usual time to deploy cavalry was after opposing infantry has wavered or has broken: at worst delaying them from regrouping, and at best converting the temporary advantage into a decisive victory.
(that said, who in a feudal society would even want armed peasantry? kind of goes against the grain of the society...)