That is not what is happening though, sharing with one person, opens up the folder for all people with a link.
If I share something with my family, who are all on Google, I would like it to ONLY be available to them. Right now there is no way to do it.