These things are very hard to quantify, but all studies so far points to microplastic being bad. Not poisonous like lead, or deadly like uranium in ceramics. Instead they are a bit more sneaky. While plastic in itself is not so bad, all the other stuff in plastic is. Take BPA [1], a known endocrine disruptor. It is especially bad for humans in the early stages of development and has life long effects. Boys will have less testosterone (leading to multiple knock off effects) and girls will have earlier puberty, more breast and other types of cancer. Because the doses are so low the effect are not typically seen in individuals. Instead we detect them on population scale. An example is the testosterone levels of men is dwindling each year [2]. Of course correlation does not equal causation, but more and more studies are pointing to chemical disruption.
[1] https://pubmed.ncbi.nlm.nih.gov/21605673/ [2] https://academic.oup.com/jcem/article/92/1/196/2598434?login...