Eating excessive saturated fat is what your liver turns into too much "bad cholesterol" and what you need to watch if you're having cholesterol problems. Cholesterol in food doesn't usually translate to you having more cholesterol in your blood.
So for some individuals with a super clean, low cholesterol diet, adding dietary cholesterol would significantly impact their serum cholesterol. But for many (arguably most), it won't make much of a difference, which is one of the reasons DC has moved down in importance in dietary guidelines.