In the ideal world, you probably should have enough redundancy in terms of human resources so that one person leaving is just slightly inconvenient. Also, as an employer, you should be realistic that it's just a job to most of the people and they will leave whenever a better offer comes, just a matter of time.
So in the ideal world, there's nothing wrong.
However, we don't live in such a world, unfortunately, and should adjust accordingly.
There are many small companies that would struggle horribly if one of the key employees would leave, and eventually they will. Also, some employers expect loyalty and treat it very personally if they know that someone's is definitely looking to jump the ship.
It's right, I agree, but that's how it is usually.