You’re welcome to limit your definition of hacking, I prefer to keep an open mind.
Since you used an elevator as a metaphor, to me, it’s like opening an unlocked elevator control panel to reroute the signals to achieve a goal that’s not possible via a locked panel; for example, access a floor that normally would require a high security key. Easy, yes, an intended use of the system, no. Would doing so potently be trespassing? Depends on the context, but possibly, if not likely, yes.