Memories are things of the past. They might comfort you when lonely or make you nostalgic. More important than searching for what brings us happiness would be knowing what happiness itself is.
Is it just a feeling of elevation, of euphoria? I would consider a person happy if his mind is calm, devoid of regrets of the past and anxieties of the future.