They are special enough to cause serious harm to progress if patented. This was demonstrated many times. Since the whole point of patents is to promote progress, software patents should not exist.

From what we see, software patents have caused more harm than good, but would be great if there were enough concrete public examples listed somewhere that prove otherwise.