A key limitation is that the early universe had virtually no heavy elements whatsoever, and it is far too fantastical to suppose there might have been life in the form of hydrogen-positron crystals or whatever. It took billions of years of supernovas for protoplanetary disks to include metals, complex organic molecules, etc, and perhaps even longer to make planets with enough chemical entropy to support life.