I just think it is super weird to be completely, categorically opposed to remote work when a primary goal is diversity. It is a severe constraint on hiring, and you want super flexible hiring to maximize diversity.
Wanting diversity doesn't mean having unlimited willingess to sacrifice quality of work to get it.