Indeed, sounds like a problem with the fan. My 3000sf house uses 1100W for the fan, and about 4000W for the heat pump. I expect converting to mini-splits would increase, not decrease my overall power usage.
The stat is that you lose between 25-40% efficiency for "typical" existing installations. The document goes on to explain that an insulated duct which doesn't leak doesn't have this kind of efficiency loss.
[1] https://www.google.com/url?q=https://www1.eere.energy.gov/bu...