(IANAL)
Unless you have something bizarre in your contract it's unlikely they could sue. Unless specifically stated the fact that you quit wouldn't be counted as company confidential information. Further more given the person you told is a board member of the company it's not clear that anything you told them could breach confidentiality.
Normally most companies have a clause specifically saying you can't claim to work for them after you leave the company.