Even humans have neurons in the heart and the gut. It would not surprise me that some kind of memory can be stored in there as well.
I'm not up to date on heart anatomy, though. As I recall, it's true that cardiomycytes also perform some neuron-like functions, but wasn't there a "pulse clock" bundle that's made up of neurons? Or are those still cardiomycytes?
They make up the autonomic nervous system, which is the network of motor and sensor neurons connected to the central nervous system (brain and spinal cord). The latter does your thinking, the former keeps you from suffocating.
[1] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4404375/
[2] https://en.wikipedia.org/wiki/Vagus_nerve#/media/File:Gray79...