Not sure what went wrong and I'm not sure about the exact measurements but your synth has huge input or output latency, maybe around 100ms or something like that? Other WASM/web synths I've tried doesn't suffer from the same problem.
Otherwise it's a nifty little toy, thanks for sharing :) Lots of fun.