Except that the Greek-speaking part was as Roman as the Latin-speaking part in culture, heritage, bureaucracy, governance, and self-identity. The later Western European historians' designation of the East as "Byzantine" (read: not "real" Romans) is much motivated by the West Europe's desire to see themselves as intellectual descendants of the Roman Empire (n.b. Italian Renaissance and Classicism).
Not that much. It was roman in leadership and had the roman legal structures, but it was always the area of prior Greece and the Hellenistic kindgoms, which had millenia of history and culture all of its own (to the point of the Roman's saying that when they conquered it millitarily, it conquered them culturally).
Completing the conquest of the Mediterranean basin and being left bordering only states against whom the Romans never had any particular success, the Sahara, (Parthians/Sassanids) or holding the line against rotating groups of peoples pushed further west in the Balkans and Germania left the Roman state without obvious paths to expansion. That does not mean that Hellenistic states "conquered them culturally".
If you think the West was some unified area with "Latin-speaking" culture, heritage, bureaucracy, and self-identity, you'd need to write a thesis-length paper justifying it no matter what century. Even the Italian peninsula was none of those things until long after the establishment of the Principate, at which point wealth had already precluded the existence of men like Cincinnatus.
If the classical Roman citizen weren't horrified at the organizational changes under Diocletian, or the difference in response between Adrianopole and Cannae, or moving the Imperial seat, or Romanized barbarians leading legionary armies (all of which were 100+ years before the fall of the west), they'd keep going.
The fact that the population in the East spoke Greek (and Syraic, and Aramaic, and a bunch of other languages) is a meaningless distinction. The West never truly had a formalized language anyway, at least among the citizens. The East had the same history, the same institutions, the same government