It's difficult to tell when browsing. It's fairly obvious when the goods arrive.

If the appeal to shopping on Etsy is (like it is for me) that you're buying handmade goods from the individuals who make them (and paying a premium to do so), then yes -- it matters a ton.

Usually, when you buy things that are drop shipped they are also marked up a ridiculous amount.