The (mostly) lisp code from the first edition can be found here: https://webdocs.cs.ualberta.ca/~sutton/book/code/code.html