The plus button is to add a task.

The up/down arrow button is to reorder tasks. Click and drag, make sure your cursor stays over the tasks. You can also re-order with shift+up/down.