Apparently not. Talk me into it.
You're leaving yourself open to having something exploited. Have a look at your ssh logs where "people" are constantly trying to get in.
https://www.whitesourcesoftware.com/resources/blog/top-10-li...
Another reason though to reboot every so often is for the server to do filesystem checks on the root partition(s).
Yes, I check my logs and see the constant stream of breakin attempts. Basic security precautions seem to keep them out.