Paper.js simply isn't meant to be used to draw thousands of rectangles. You should only use something GPU-based for that, like Pixi or Three.

I love Paper.js because it has a TON of super useful vector features and is still is reasonably fast :D