I think that makes a lot of sense and worth a shot. Might be worth removing (many) more pages until your rankings come back to see as a test.