"Open access" is not the same as "not peer reviewed." There is no subscription required to get the articles in the journal, but it is peer-reviewed.
From the page for the Warne et al. paper from the OP link (http://psycnet.apa.org/record/2018-07714-001):
>Publication Type: Journal; Peer Reviewed Journal
From the publication announcing "Archives of Scientific Psychology" (http://psycnet.apa.org/fulltext/2013-03009-001.pdf):
>Archives of Scientific Psychology uses peer review to determine whether a submitted manuscript is suitable for publication. Authors are free to submit manuscripts that reveal their identity or that are prepared to keep reviewers unaware of who they are. We adopted this policy because we are unconvinced that evidence on peer review rules out the possibility that some reviewers’ evaluations of manuscripts are influenced by characteristics of authors (Shatz, 2004; Weller, 2001). Likewise, reviewers will be given the option of revealing themselves to the authors.