Do you not patch your kernel?
You're leaving yourself open to having something exploited. Have a look at your ssh logs where "people" are constantly trying to get in.
https://www.whitesourcesoftware.com/resources/blog/top-10-li...
Yes, I check my logs and see the constant stream of breakin attempts. Basic security precautions seem to keep them out.
Another reason though to reboot every so often is for the server to do filesystem checks on the root partition(s).