I think what is easy to overlook with Dostoevsky is that although he is arguably the inventor of the psychological novel, the characters in his novels are largely representatives of the impact of ideologies on the lives and psyches of real people or the impact of the psyches (as impacted themselves by their life experiences) on their choice of ideology. The taking of ideologies to their logical conclusion in his character's lives is what results in "hysterical characters".
I think to argue that Dostoevsky is not among the best psychological novelists is to slightly misunderstand what he was trying to achieve.