Not all phones have access to baseband controls, and I’ve never seen a “turn off 2G” option, but yes you can turn off 3/4G.
It’s easy to get a burner phone in some countries, but many you need a passport or government-issued ID to even get a prepaid SIM! Let alone a phone!
Governments really don’t like citizenry to be anonymous.