That is exactly the case. Look at the companies that scream the loudest about diversity and have diversity internship programs(FB, MSFT, Google). Smaller companies do not have the budget to hire "diversity officers". They spend their budget hiring the best people they can find.