This is a little misleading. Under Clinton, they could basically just turn them around at a port of entry. Eventually (2004) this was expanded to people within 100 miles of a border within 2 weeks of entering the country, and then in 2020 they _dramatically_ expanded this to people anyone who has been here for less than 2 years, and that has not been tested in court, really.
This is sort of a classic example of a slippery slope, FWIW. As soon as you deny anybody due process, the category of people that applies to will just constantly expand.
Now, there's basically nothing stopping immigration officials from immediately deporting anybody they want, citizen, non-citizen, illegal or legal immigrant.