It's interesting to think about what mathematics might have been like if geometry hadn't been developed so early. If algebra or number theory had come first, the history of mathematics might have been quite different.
Alternatively, you could start from the Peano axioms and grind your way up to number theory.
High school mathematics spends much time on plane geometry as a formal system for historical reasons, not because it's a particularly interesting or useful formal system.