The struct can be optimized but if we keep growing it with our features we hit the same problem for the cache line sequential access.

Smaller structs help with keeping working set down though.