Do you have source of truth for if that job is still active? For example, is the job description still publicly visible from your ATS (Greehouse, Lever, etc)
I asked because I've been thinking about this problem with job boards. Job boards often duplicate job description information rather than relying on the original JD in the company's ATS.