You're right on the average. Almost every scenario has global GDP per capita higher in 2100 than today.
Burke/Hsiang/Miguel [1] find poorest 40% of countries down ~75% and richest 20% up slightly.
So "we get richer" and "grandkids are worse off" are both true. Depends whose grandkids!