Which administrators tho? There are about a dozen I rely on every day, and if you eliminate them, you'll be causing a lot more work for me, the researcher. Many admin positions are created after faculty complain their workload is getting too large. A lot of people seem to think they are just bloat, but they can actually be very helpful. To be constructive, you need to be more specific than parroting the "just get rid of admin" trope.
A lot of people like hand waving and saying "Administrators", but like the idea that most regulations are written in blood, there are tangible reasons for most administrative positions. Even the admins I don't like and I think are a waste of space are that way because of them, and I can envision a useful person being in their place.
As for beautification projects: that projects often bring in big donars. It is hard to say if they are worth the costs or not, but we need to start by being clear. A ugly brutalist building would be a lot cheaper but probably is too far the other way.