I assumed many of the small needles remain in the skin and are difficult to remove fully.
yup, the needles contain the poison and the poison doesn't break down or deteriorate. Given that only a super small amount of poison is required to induce pain, the needles and poison can conceivably outlive the "host"