Here's a can of worms... Compare the concept of time travel to something like 'smell travel'. Is it really that different? We are conditioned to know what smell is because our body has a mechanism to "interpret" particles and send signals to our brain which we 'remember'... How do we know that Time is any different? Perhaps travelling back in time is a flawed concept in itself, in the same way that "travel back in hearing" or "travel back in smell" makes little sense at all because we're just describing an effect or mechanism of our biology, rather than an effect or mechanism of the universe.