Yes, indeed. And even disregarding the mass of the destination and of the ferrying craft, the mass of life support systems and consumables for each individual on the way up and down are likely at least double this anyway.
But, longer term, consider what happens if/when there is existing infrastructure in LEO and highly productive and profitable work for an individual to do there. The cost of actually getting to LEO will be a relatively minor relocation cost, even at these numbers.