With RSM you often need to keep the history as well, just in a different form, that is the message/event log that your state machine processed.

With RSM you need your code to be deterministic to rebuild the materialized state during failover, unless you snapshot and replicate the state on each processed event/message.