It makes a difference. Probably a big one.
Individuals with experience in specialized areas and in leading in those areas can make a large impact in any company (their own or otherwise). How can you assume that losing individuals making a large impact wouldn't have an impact itself?