I also prefer Amazon over other ebook stores simply because I know I can break the DRM effortlessly and reliably.
I am well-aware that it's a bad thing to do from a legal perspective (and especially encouraging others to do the same), but legal =/= moral. I'm paying a full price for them and treating them as my property. That includes being able to read them on any screen I want with whichever reader I want, even if I do end up mostly reading on a (physical) Kindle.