Its an interesting question, if you removed the artifacts, and kept the same organizations and relationships, my guess is that would mean almost no change. Instead of doing calculations with computers you would do computations with computers. (The first computers where human). If you removed the books and tax-software, still the tax people would walk around collecting their taxes and "inventing" bookkeeping. And we, fellow programmers, would still ponder of nice mind tricks and think of their solutions then apply them in society.
I guess the first most important step is for everyone to start documenting everything they know of science, creating a kind of ad-hoc paper Wikipedia (once we make paper, of course). If the current generations die before their knowledge is recorded or passed down, we're going to be held back hundreds of unnecessary years.
I imagine with some excellent leadership and coordination, we could be back to computers, complex medicine, and aircrafts within a century. Maybe even decades, if the culture shock doesn't trigger famine, disease, wars, and depression.