Swapping on the SD card is a nightmare. I found out that disabling the swap actually leads to a better experience, even if it means that firefox gets killed from time to time.

[This comment was written on a rpi4, btw.]