Yes, but a very very low percentage of the contracts that expire result in delivery. Delivery is expensive. It's cheaper to get oil through a supplier.
Thus, traders who still have contracts open but cannot take physical delivery will have to close their positions out today or tomorrow, thus causing the dip we are seeing.