Can't have been that bad then. General employment is a nightmare, I've only changed jobs once in the last 8 years because it's so many BS hoops to jump through.
The difference is person in H1B faces same issues as you but there are more issues which are frankly more complicated and time consuming due to visa related things.