Replacing the reranker with the pruner completely was not feasable since it would have to run on the 150-200 chunks we retrieve before reranking.

Yep seems like the pruner and reranker could be combined. That is what i built.