Ugh. Can you try with a lighter compression level? There is a command line switch for that, and it should also show the memory requirements for each compression level.
I'm insisting because PAQ is a really incredible collection of compressors. Far more intelligence in it than in the LZ* bunch.