Sure, but the half life of cannabinoid metabolites is weeks, so this is possibly still an active combinatory effect rather than a residual one.
I do notice that if I smoke crazy amounts (ounces per week) then I do end up with latent cognitive deficits, such as substituting homophones in my writing and losing my train of thought mid-sentence, but they vanish with a few weeks of abstinence.
I'm not ruling out the possibly of cumulative, long term effects, and I'll vouch that massively overdoing it over a long period will make you REALLY ill (read up on Cannabis Hyperemesis Syndrome... It's worse than death), but from my idiopathic stance I'm not seeing long term cognitive effects. I started as an adult, my only childhood vice was drink.