It would be worth to add a slow RAM slot or two to use it purely as an SSD cache or a substitute for swap. There's no need to eliminate the unified memory in the process of adding upgrade options.