Who was rich in Imperial China? In most travelogues I've read about China in the 1800s, there was huge and deep poverty then too.

Just like with most Empires, that wealth was heavily concentrated with the rich and powerful, a very small group of elites.