Why is that? You get the same thing with emails / IRC / some IM protocols / VoIP. What's so "scary" about someone knowing your current IP?
I mean - it's one thing if Skype was advertising itself as a privacy protecting, identity hiding service... but they don't. They provide convenient A/V connections.