Similar to most programs, you can change certain behaviors in the settings of the program. For Firefox update behavior:
Settings -> General -> Firefox Updates -> "Check for updates but let you choose when to install them".
Or, you can choose "Automatically install updates" and subsequently check "When Firefox is not running".
Either way should address your issue.