I wouldn't call the thousands of researchers in the field unscientific at all. And this process is iterative. If you have an algorithm that works, the proximity to how the brain actually works is largely irrelevant.
There has been considerable progress in understanding the working of human memory in the past many decades.