It is also trivially the case that "due process is good, but not the highest good". Or, to take a less charged example, freedom of contracts
I don't mean to be snarky, but to try to draw a line. There are goods and rights that are intrinsically important (say food, water, social life, freedom from crime) and some that are important for the maintaining of a society (contracts are a good example here).
One of these "to maintain a society" freedoms is due process. Another, free speech. Both are important for their own sake, but also to check and control power.
You can say, and it is reasonable to say, that not suffering the ill effects of crime is more important than having good due process. But, given that due process is an important check on those in power, whenever they say "we need to reduce due process to get better law enforcement", you should be wary.
To sum up: some seemingly rational trades between values are dangerous, especially since they reduce our ability to influence society/to undo those trades.