This annoyed me too, so I made a shortcut for disabling Bluetooth and put it on my home screen.
2. Create shortcut in the "Widgets" folder, which simply runs one action: "Turn Bluetooth Off"
3. Long press home screen to add widget, then select shortcuts widget