While it sounds plausible on the surface, this is not at all supported empirically. There have never been economies without fractional reserve banking that one could reasonably compare with ours.
There are also plausible-sounding arguments to be made in the opposite direction: Fractional reserve banking allows money to be created and destroyed adaptively to support the economy, which makes the economy run more smoothly overall.