The threat model that's addressed by deletion of message is the seizing of one's device by a hostile party (eg dictatorship). One cannot be incriminated by messages that have been deleted.
As you pointed out this will not help if your correspondent cannot be trusted.