Make sure the notification is visible (you can minimize it though), and also switch to syncthing-fork if you haven't yet.
For some reason I can swipe it away too, while from what I remember, persisting apps like this used to prevent you from doing so