If it's literal bits etched into stone, wouldn't it still be digital (the way sections of a disk platter having a particular polarity is digital)? Analog would be etching the resultant data in graphical form into the rock. I'm not sure what to call ASCII art carved into rock, tho.

What kind of storage is binary technically?

Are you thinking that the digits should be physically unconnected solid objects? That would be an unconventional definition, not the one used by computer scientists and engineers.