Unless the standard has been substantially relaxed since HDMI v1.3a, it sounds like a downstream issue.

Citing § 7.5 normative language:

> An HDMI Source shall be capable of transmitting audio and video data streams with no more than ±2 msec of audio delay relative to the video.