It feels like the most common workflow is pressing that button in the top right to open the label list, opening the dropdown, and selecting a label. I think this could be optimized.

One idea: Bind the label list menu to a key like spacebar. Replace the dropdown menu with a list of labels which are already clickable, no need to open the dropdown. This would change the workflow of selecting a label from 3 clicks to 1 click.