That would be a tough one. There's no information which part of HTML is controls. Maybe they may hardcode this information for some popular players, but that would break as soon as for example Youtube decided to change the layout a bit.