Another contributing factor with the jank is the "snapping" to discrete zoom levels. One of the primary benefits of rendering vector tiles is continuous zoom!

Also, the direction mode toggle you mention does exist, and works quite well. The flipside of Osmand's awesome configurability is that it takes me 5 minutes of digging to figure out how to enable things like this.