Microbial growth on wood is really only an issue when conditions are right -- namely, when the wood is wet for an extended period of time.

Washing wood utensils immediately after use, with some soap if needed, and drying quickly and completely, should eliminate 99%+ of the risk.