I had worked on a similar weekend project where you control an actual toy car with the iPad. (I'll probably blog about it soon)

I solved the latency problem by using websockets. I know, it's not a widely used standard but was good enough for a weekend project.