Yes, it is the same as the "group" in group theory. However, I the name is a misnomer since I believe it is technically a semigroup because the binary operator is not invertable.
in a renormalization group the elements would be "renormalization functions"? and the operator would be function composition?