Have you looked thoroughly over https://docs.julialang.org/en/v1/stdlib/LinearAlgebra/ ?
There's a ton of in-place operations there, including in-place solving of linear systems, and at least some stuff related to svd (though the names are pretty un-intuitive, being wrappers for BLAS and LAPACK functions).