It's a problem because the people who are using bitcoin have seen the value drop to less than 10% of what it was, so why should they trust it to be a currency worth using?
For it to be a currency it doesn't need a huge value per bitcoin, nor does it need to be constantly rising a huge amount - but it does need to be reasonably stable.