The example in the article is an in house developed "A.I." to help radiologists assess images. Digging a bit deeper it seems they are using mostly old CNN type architectures with a few million parameters.[1]
I think it still remains to be seen what a 1T+ parameter transformer trained specifically for radiology will do. I think anyone would be confident that a locally run CNN will not hold a candle to it.
[1]https://mayo-radiology-informatics-lab.github.io/MIDeL/index...