In practice I am not sure it is so easy to say "no thanks" to your adult baptism and abandon everyone and everything you've known up to that point.
https://en.wikipedia.org/wiki/Devil's_Playground_(2002_film)
And also, sadly, many Amish flee physical and sexual abuse: https://duckduckgo.com/?q=Amish+abuse&ia=web