>merely a debugging server that could be enabled and allowed you to inspect internal state during runtime

When we talk about CPU it's bad enough. Think that your program has an input and output streams where most of the app data goes through and I can attach debugger and listen on the data.

I would not be very happy about it and would still consider it backdoor.