This is environmental determinism and it is an old concept. Obviously we live with others and other can have impact on us but it is still up to us if are impacted by them or we are self contained human beings which decide for themselves.
I think this is in some way separate from the metaphysical issue of free will and determinism, since whether our choices are determined by the universe or by us is quite a separate question to the extent to which society influences our choices in general. In my experience, it is absolutely not "still up to us" whether we are influenced by these factors, and a belief that it is up to us is more dangerous since it's delusional. The whole existence of the field of psychology, advertising, politics and propaganda is based on the idea that many things are not up to us - unfortunately we don't get to decide, but we like to think that we do.
Our desires, hopes, fears, opinions etc. are all imported from outside sources to a great extent, and it takes critical thinking to seriously ask about those - critical thinking we very rarely, if ever, apply to ourselves, because it leads to a kind of cognitive dissonance. I have personally suffered through this as I went deeper into political philosophy and saw that many concepts I held so dearly to were simply unsubstantiated, things that I believed due to ideological factors (from which none of us are ever free) and from my friends and relatives (which we may distance ourselves from to some extent only).
The idea we have control over these things without this critical-induced "pain" of having to confront ourselves is farcical.