It's more of a go problem than the wasm problem. Don't bundle such a big runtime and pass memory pointers around and you can have nice things.
Something beam-hosted with zero pointer sharing between nodes and smaller runtime maps to wasm much better.