The US also did annex large parts of what used to be Mexico in the 19th century, so you don't even technically have so be an immigrant to speak Spanish
Their country lost the war, lost the territory, and those that stayed and chose to take American citizenship should've learned English, the (de facto) language of the country they chose to join.