This used to happen back when phones could only keep a few apps backgrounded at a time, but I haven't seen iOS kill the most recently used background app since the first couple years backgrounding was supported at all.
But then, apps in that environment were made for no swap. If you take away swap on a desktop system it could be another story.