I don’t believe it is currently possible for a WebAssembly instance to access any buffer other than its own memory. You have to copy data in and out.
But if the module wants to compute on the values in the buffer, at some level it would have to copy the data in/out.