Different models have different inductive biases. There is no way you could build GPT4 with decision trees.