>> Just have to stumble upon it.

You can physically remove it from the whales, which is why ambergris trade is illegal in many countries. Even where legal, you have to be able to prove that it was pooped out and found, that you didn't kill a whale to get it.