Transall Saga by Gary Paulson. One of those young adult survival stories he was known for writing but with a sci-fi element. The book has been living rent free in my head since an elementary school book fair 26 years ago.