Not really. Arlington VA was retroceded, no reason the rest (aside from actual federal buildings and facilities) couldn't be.
Each year DC pays more federal taxes per capita than every other state. In raw dollars it is more than 22 other states. [2] The people of DC want representation to go along with that taxation.
[1] https://www.publicpolicypolling.com/wp-content/uploads/2017/..., Q22 on page 6.