Yes. As I said matching the population base rate wouldn't be practical, so you'd need to educate on that separately from the identification learning.

Let's say I achieve a 95% on the app though. Most people would have a massively over-inflated sense of their correctness in the wild. If the actual fraction is only 1/1000 and I see a friend with a lesion I identify as concerning, then my actual success rate would be:

    1*0.95 / (0.05*999 + 1*0.95)

So ~1.8%, not 95%. Few people understand Bayesian updating.