To an extent, yes https://www.reddit.com/r/xboxinsiders/comments/cj5b0a/what_h...
tl;dr The banned account can still play games in offline mode but can't re-download them since this is done through the XBox Live service. Other users of that XBox can do everything as normal including play and re-download games that were installed by the banned account.