Empathy as a cultural artefact is imbedded in large learning models insofar as one might find it expressed in their training set as human language.
It follows then that LLMs do in fact -express- empathy (as prose) even though they of course do not experience empathy as an emotion or as a call to action.
It’s important to remember that although LLMs do not have an emotional existence, they are portals through which we access a significant corpus of human knowledge, language, and culture. It follows that they will be capable and even adept at expressing elements of that knowledge, language, and culture - including parts we think of as emotionally driven.