GPT4 relies heavily on human curated data. Both for specific domains and for instruction following. Any new model that tries to go beyond it will also likely rely on such data.
Yeah it's been known that OpenAI hires domain experts. If anything, they augment that high quality data rather than just starting from bare bones synthetic data.