It's a bit screwy, but you can filter by seller by clicking into a specific product category, and then selecting Amazon.com in the bar on the left. Then all the items should be "shipped and sold by Amazon.com".
But I've been sort of shocked to find recently that Amazon's prices, even with free shipping, are often not competitive with buying first-party, even with paying the shipping. For a lot of products these days, if there's a recognizable name brand associated with it, I just by first-party. You get it slower, but you know what you're getting, and probably end up giving more money to the seller too.
I would not have seen myself doing this ten years ago.