Not necessarily. One can walk into a bank, slide a note and a bag, and (hopefully) walk out. No threats involved. Still a federal crime.
The reason the note works is banks don't want to pay the cost of having their employees getting their brains blown out. Passing a note with this understanding means one knows they are making a threat.