We had an original IBM PC (not a clone, genuine IBM), and I actually don't recall it doing that. Maybe that was on some models and not others?

The way I accessed BASIC was to boot up PC-DOS (IBM-branded version of MS-DOS) and then run some program that was like QBASIC although it might not have been called that yet. Later I switched to MS-DOS 3.21, and that came with real QBASIC. I also switched from BASIC to Turbo Pascal and Turbo C. Great times!