Fannie Mae and Freddie Mac restrict the maximum amount of the conforming loans which could help limit prices going to the moon. However, popular pressure will be applied for them to increase the limits (or "they're hurting 'poor' people who don't own a home".