Sounds like your agile process was actually "flacid agile", this is very common. Suffering this at my current workplace too.
If you don't have "strong" - i.e. skilled and disciplined - people, or you can't allow things to happen outside "just because ok?"-rules, it's flaccid agile.
Like jelly in a glove, it's flexible but not in a useful way.