I've published a couple of papers in decent pure math journals with no affiliation at all. It didn't cause any issues.