Yes, you can disable the internal apps it ships with if you don't want to use them and just not install any third-party ones either. Only caveat is during one upgrade I noticed some of them had been re-enabled so now I make sure to check each time.