Just include an SVG sprite in the HTML page. Then, like the article says, you can reference each icon with <use href="#icon-name" /> and they will be available far before your js bundle is parsed.
“How else could you possibly have SVGs render inline other than to include a massively bloated JS representation of a string in your bundle?”
- the React ecosystem, 2023
The answer, as you’ve shown, is “use the platform”. Sometimes I feel like React actively works against that.