Sure, but the CPU can amortize that cost over many packets if it is infrequent, while maintaining the same throughput. Also, cache line sized packets are relatively tiny.