You can't tell whether a polyp is cancerous or not before you have removed it, sent it to the lab and got the results back.

Therefore, all polyps should be removed. (Sending them all to the lab might be superfluous though)