Like, without that inert gas there would have to be something else. Being in a pure oxygen environment for a prolonged period has health impacts to many animals including us. Anything even remotely flammable, like paper, wood, sugar, would burn uncontrollably with the slightest spark.
If you didn't have nitrogen you would need another inert gas to make up 80% (or whatever) of the atmosphere you were going to make.