Yes, the existence of the Fed and the fact that it does monetary policy is part of the given for most of the people who predicted the inflation surge would turn out to be transitory, rather than durable.
> Interest rates staying low because of pandemic fears is the reason we had this gigantic inflation
They are a factor, more precisely, the combination of monetary and fiscal stimulus enacted in response an economic slowdown that, in retrospect, turns out to have been both one of the most rapid on record, but also extremely short and with a rapid rebound, overshot in monetary effect terms, leaving the US largely all in on stimulus during one of the most powerful economic rebounds in history.
So its probably correct to say that the monetary contraction the US is currently experiencing is due to high interest rates, but that doesn't stop the inflation that has already been caused by initial money printing.
[1] https://noahpinion.substack.com/p/is-the-fed-hiking-too-fast