There's a lot of variation in responsiveness between different apps. Have you tried Penultimate? You certainly may be more discerning than I, but I've found it to have almost no lag.
I find handwriting with my fingers to be a bit unnatural, unfortunately; it tends to break my flow.