memtest is a pretty basic test and is not very reliable at triggering errors in memory pushed just past of what it is capable of. It's fine to run it as a smoke test before booting into the operating system (to make sure it won't crash right away), but after that you're gonna need something like TestMem5. I keep a Windows install just for this.