In case you haven't realized yet, a hash table that maintains the insertion order can be still do O(1) deletes as long as the key order doesn't change arbitrarily after the initial insertion.
That's obviously not what the OP meant. Also, I don't think there's an efficient way of implementing deletes with an array backed linked list.