I don't know what's going on in your specific case but:
1. It's never out of time, for sure. If you want to make a specific change, study the pros/cons and decide whether to do it or not! But you can for sure make the change you want to.
2. Don't fall into the trap of idealizing a life you don't have. The grass is significantly less green than you might think at the other side of the fence.