I've actually cleared it out before and didn't even realize what it was. I volunteer to clean up invasive species, and we end up pulling a lot out when we clean up buckthorn along with garlic mustard. I probably knew it was hemlock at one point it time, but it didn't really stick.
It looks very similar to lots of other plants, some of which are edible like fennel.