Got to say after figuring this out I am tempted to ditch the western style mattress and replace it with something like a Japanese futon. I assume it'd be much easier to wash.
In the meantime I need to purchase a mattress encasement, I put one on my pillow and that alone helped a bunch.
Long term maybe desensitization is an option but I'm too lazy for that atm.