I would say if you have any sort of feeling something isn't right, then talk to your doctor. A DRE alone would probably be enough if you are super worried.