Nope, any bitcoin client can verify any transaction very easily. (Bootstrapping by verifying every transaction in the blockchain does take a while though.) Proof of work is only to prevent a 51% attack where someone spins up enough bots to hijack "consensus" and rewrite transaction history. That's why the difficulty can be dialed up or down - most of the work in mining is not related to verifying the transactions.