Setting the rest of the discussion aside, I think there is an argument for specializing care. People with learning disabilities would benefit from attention from experts, people with at-home problems would benefit from school-based childcare (for them, school lunches and afterschool programs would be disproportionately helpful), and while people with physical disabilities need the same good teachers they benefit from specialized access mechanisms as well (for example there are schools for the blind, where knowledge about blindness is concentrated in the staff to an extent not present elsewhere.) Children with physical disabilities have no need for dyslexia experts, children with lots of support at home have no need for elaborate all-day childcare, and so on.

So, there are clear efficiency and quality gains to be had if the system is specialized. Physical disabilities are one of the most stand-out cases, where you can invest in special access mechanisms and make special testing conditions normal if you concentrate enough people with the same needs in one place. See: Schools for the deaf, schools for the blind.