Well to use an analogy it's possible for a competitor starting 200m from the finish line to beat one starting 50m from the finish line. Is it a fair race? Most people would think no.
It's not about determinism at all, and pointing to people born in shitty situations who managed through luck and hard-work to overcome those difficulties does not mean everything is all-right, that is just silly.