You can step over or walk around cracked and buckled concrete.
Trains don’t appreciate having their rail ballast disturbed.
I think trains are ok with trees. I checked satellite view - there are a lot of rail tracks in Chicago going directly along tree lines. The rail yards indeed look like tracks on concrete with nothing else, but when I look at German ones - there are trees and bushes.