Of course it does. Bitcoin used to be at $1, now it's at $1,xxx. What happened in between was a massive influx of newcomers.
The difference to, for example, the stock market is in the "underlying value". If I buy some stock and it's price collapsed the next day, I'm still entitled to my share of future profits etc. If the company is sound, I have lost nothing.
A ponzi scheme's underlying value is only the future growth of the scheme itself.
I'd say the jury is still out for bitcoin et alt: how much of the growth is being fuelled by speculation, and to what extend is that speculation actually speculating on future speculation?