Two things cost a lot. Salary and rent.
Work from home. If you work with a team use Talker and Teambox.
Don't pay yourself as much as you normally would until you reach profitability. If you work from home this shouldn't be a problem. You may end up saving lots of money this way.