Seems like pulling out an oil-drenched card would let oil into the PCI slot, which would then cause issues when a new card is inserted. Do you have experience with that?
I'd imagine just having a compressed air line run over to the workbench would be sufficient.