Most likely their mom's husband was "daddy" and they were raised like their half-siblings, as peasants.