One of those things people will speculate on is if this was one of the reasons. The fact that it is also part of the equation means it can’t be outright ignored and so will also need to be addressed. On top of that, this is already an underrepresented group, and regardless of if it was a primary motivating factor, it does not help show that group that they are welcome and in fact harms any effort to do so.
It absolutely matters if it was or was not a factor in this decision, but without clear information about the decision making process, speculation will occur, and that in and of itself is harmful.