This applies to Twitter iOS and probably Web and Android too. If a tweet is in your feed and gets deleted, it’ll stay in your feed (but show “This tweet has been deleted” if you try to reply or look at replies)