nbval does something similar to what you want.

https://github.com/computationalmodelling/nbval