Socketstream is a framework in active development based on exactly that idea.