In case of a shooting war all those F-35 would get destroyed by cruise missiles before they could take off. The only reason for Poland getting F-35 is trying to please the US and to participate in NATO missions.
Also, an attack of that nature would would certainly trigger Section 5 of the Collective Defense, and then US resupply. I suspect most NATO members who buy the very expensive F-35 do so in the belief (or hope) that the US will replace these aircraft immediately, from US squadrons, if necessary.