I did a similar proof of concept a while ago [1]. It outputs an emoji for an image or video frame based on facial emotion.

[1]: https://gist.github.com/shanev/c70099b3305e71c6a1232a42029f7...