I signed up to comment...
As someone who has watched a colleague make some similar unplanned decisions (who is now doing absolutely fine with his career) I will say that your on the bell curve of life. You worked your way up to the top and now your down the bottom on the other side, like all trends you can only go one way and that is up.