The Universal Recommender (part of the Harness project) allows contextual and multimodal behavioral information to be used in recs. https://github.com/actionml/harness