But my friends roughly know my living standard... so coming up with an excuse that is most probably a lie will not be met more favorably I would assume.
There's a difference between "don't want to" and "can't do".
But, we have a pretty tight-knit group of friends, most of whom live within walking distance, and due to kids, we usually just have dinner at somebody's house. We're boring white collar suburbanites, I guess.