A sane OS would let me delete a file with the delete key(!).
I'm just kidding, it's a superficial annoyance.
I should have the option though, and what's the purpose of a "recycle bin" if not for feline file administration?
No. This is what good software design is. The designer chose this path, offering you the option to change this is what makes software bloated and unmaintainable.
Options should only be there as a last resort, not in any other case.
Command-Shift-Delete empties the trash, finalizing the action.