This kind of thing is repeated often, but I don't think it's true. For one thing, how would tattoos last so long then?
More relevantly, I don't think neurons are replaced. There must be some material churn in the atoms and molecules that make them up, but even then different for different molecules - e.g. I don't know how much of our DNA molecules get replaced over a lifespan from the repair or other mechanisms.