Supreme Court Upholds Patent Office Power to Invalidate Bad Patents
eff.org
eff.org
Bloomberg: "Patent ‘Death Squad’ System Upheld by U.S. Supreme Court"
EFF: "Supreme Court Upholds Patent Office Power to Invalidate Bad Patents"
If the Social Security Administration (an executive agency) gives you $1,000 per month, it can probably decide to stop that monthly payment. But to get the money back, it probably has to sue you in an Article III court.
Conventionally, you need a court with an Article III judge for that to ensure due process.