I would say that Julia not only supports a REPL, but is heavily biased towards its usage - enough to be detrimental IMO.
Most of the infrastructure is there in the code, it just needs to be tied together, in such a way that juliac file.jl -o file.x results in a deployable (preferably static) binary.