On early version reset button can't be used to override boot rom boot order. It's just a literal SoC reset button. Newer revisions have RE button, that can override it.

So if it was early revision, I can understand the frustration.