"Go straight up until you leave the atmosphere and then fall down" is a radically different proposition than reaching orbit. You could lift an unprotected human being to space with a 700kg rocket. Getting him to orbit would require a 9,000kg rocket.
https://rocketry.wordpress.com/2014/08/18/amateur-rocket-tea...