My understanding is that this is true only if you distribute your executables which most people don't do for server-side code.
Same thing if you make changes to Ghostly itself and don't distribute the binary. Those changes are GPL but you can keep them to you.
If you are working for customers and the IP of the software is yours but the servers are theirs, that is an act of distribution and the source code must be available. For sure customers can ask for it because binaries are distributed to them, maybe everyone else can ask it too. This is the same as GPL code on set top boxes or other devices.
If the contract states that the IP belongs to the customer, the source code is theirs but nobody else is entitled to ask for it because there is no distribution.