My old boss started his company at 52, he was running it for a decade when I joined. My dad just started a company (not software) at 75.

I started a company when I was 19, and had no clue what I was doing. There is never a wrong age to start, but as you get older you are more allergic to losing money :)