Yeah it isn't fun at all, especially when you seem to have more bad memories than good. It can become a bit of a hindrance; but with a strong will, it can be turned around into something good.
My first few memories are of the fight my parents had the defining night of their separation; then of my grandfather carrying me away from the courthouse as I wondered why I couldn't see my father (he wouldn't pay child support); and then my mother pushing a couch against our apartment door to prevent someone from breaking in, as we couldn't afford to live in a decent neighborhood. These are my first few memories, and while they might sound pretty terrible, they've easily shaped me into the person I am today, for the better. Nearly every one of my actions is driven by my determination to live freely financially and to procreate only when I'm certain I'll be able to provide a good life for my wife and children.
I have a feeling most people here have the same outlook, and may have possibly been led to it by similar events and memories of their own.
Having a photographic memory (to any extent) can have it's drawbacks, sure, but when put to the right use, the drawbacks become incredibly insignificant, as most people would imagine. For example, if I didn't have the memory that I do, I wouldn't be able to instantly know exactly which line of code needs to be changed (and to what) to fix an obscure bug described to me by a user.
And honestly, the same could be said about any situation that isn't completely debilitating. For instance, I'm also fairly OCD with occasional Tourette's (depending on my level of anxiety), and if I wasn't, it's pretty unlikely that I'd have accomplished as many things as I have. I've accepted my obsessive nature and use it to get things done. It's how you look at things that determines their usefulness.