Small chemically inert substances can gunk up your cells and tissues even if they are soft.
Anything bigger than a "small molecule" doesn't make it through the membranes into your bloodstream. Even individual proteins are too big, let alone a chunk of your frying pan big enough to see.
Either way, what you claim is simply not true by any reasoning [1], though I do agree eating teflon flakes in moderate amounts should not pose much concern.
[1] https://phys.org/news/2020-08-micro-nanoplastics-human-tissu...