So I guess the effect of the design decisions at the beginning will go towards zero as one approaches to the limits of the context window :)