Yes. You are right.

I trained classifiers with hand annotations (about 1000 contents or so)