Is vitamin D fat soluble? If so, pretty sure it needs to be consumed with fat. That's partly why it's common in milk.
"The mean peak (12-hour) plasma vitamin D-3 level after the dose was 32% (95% CI 11% to 52%) greater in subjects consuming fat-containing compared with fat-free meals (P=0.003)."
https://www.bones.nih.gov/health-info/bone/bone-health/nutri....