It depends. If you give someone code which has a LICENSE file containing the BSD 3-clause license -- you've given them a license to use that code under the specified terms in the license, i.e. without charge etc.
In order to revoke access to the code from that user, you would have to get them to legally agree (i.e. sign something) that says they agree to having their license of that code revoked / that they will not use the code.
That is just for that one user -- at that one revision of code. If you wanted it such that _nobody_ could use your old codebase -- you'd have to get anyone who is using that code under said license to legally agree not to use it.
For new revisions of code, assuming a non-copyleft license like BSD, MIT, etc., you could simply state "we were the original owners of the code, therefore we no longer license the code under the open source license" and there is no need for you to distribute that code ever again.
In fact, this is why people can legally sell open-source software made by someone else -- even if that is ethically wrong to do.
IANAL, and some of the above is light on the details, so take it with a grain of salt / try not to be too nit-picky at me =)