Technically you would pay capital gains taxes on around 250k of the gain, and 500k if you're not married. You can deduct improvements/maintenance from the gain, but capital gains from owner-occupied real estate are taxed in the US if they're large enough.