Model checking can be used to formally verify state machines. See https://en.wikipedia.org/wiki/Model_checking.