I have a similar situation.

The issue here is that the apt update changes firefox program files underneath it which needs a restart. Afaik, using the mozilla release directly is the only solution for this where the program files are changed only after exit.

Edit: This has become more common nowadays due to multiple point releases close to each other, to fix some important bug.