There's two parts to this issue: one is reverse engineering the Apple driver interface, the other is reverse engineering the third party target hardware interface.

Most vendors of graphics hardware keep their interface secret, but not all. The problem is that the set of hardware that isn't secret won't overlap much with what people have or want to run, which is pretty central to what makes Hackintoshes attractive.