When you negotiate at a dealership the dealership is deciding how small of a margin they're willing to take. Removing the dealerships means removing this added margin that you're negotiating against.