It would be with some simple tweaks. For instance, the current block does not support Cross-Attention, just Self-Attention.