I know every gram is accounted for in aerospace but OLEDs weighs so little, especially if you can just heatsink into existing metal structures nearby.

I'd wager a bunch of OLEDs will be lighter than built-in windows with all the structural reinforcing necessary to make them safe.