From a Norwegian perspective the Dutch word Wick sounds like the Norwegian word Vik or cove, bay, inlet in English. If you look at the coastal location of these towns that link seems to make some sense.
Wick is not a word that I know of, do you mean Wijk (neighborhood)? Like Noordwijk en Katwijk? Because that's almost certainly not related to 'bay'. Many coastal towns are named something with a 'dam' however (Amsterdam, Rotterdam, Monnikedam).