If employers and funding agencies would stop using publications in private, for-profit journals to evaluate whether researchers should get to keep their job or have their grants renewed, then this wouldn't be an issue.
That way you can still use historical publications to evaluate researchers on day one, and the evaluations will be accurate assuming most researchers historically each published the same percentage of articles in open access journals, but nobody will want to publish in anything but an open access journal going forward.