Even if you're a genius, it doesn't mean your child will be. I think 0.4 suggests environmental factors are more important.
Saying that you can adopt a child and raise him to be smart is approximately as foolish as claiming you can adopt a child and raise him to be tall.
Wikipedia Quote
"The general figure for the heritability of IQ, according to an authoritative American Psychological Association report, is 0.45 for children, and rises to around 0.75 for late teens and adults"
http://biorxiv.org/content/early/2016/05/05/037929
http://www.pnas.org/content/113/24/6647/F2.expansion.html
http://www.sciencedirect.com/science/article/pii/S0160289615...
https://jasoncollins.org/2016/07/22/kaufmanns-shall-the-reli...
The main driving factor seems to be educated people (and women in particular; some studies have found positive selection for men) not having children.
There's a book I read recently that I thought did a good job looking into the demographic and social shifts associated with women having high workforce participation. It's 'XX Factor' by Alison Wolf, in case you're interested. She gives a convincing tour of some thorough data, but also makes it into a manageable narrative. She also did a decent Podcast interview on Econtalk, if you want a short version.