Which C# libraries were used in comparison? The 2 I know of, EPPlus and ClosedXML, do much more than just read cell values, so it's unfair to compare against those. For example the additional complexity of handling styles adds overhead.
Disclaimer: I'm a current ClosedXML contributor.