Yes. For example when word2vec came out, immediately there were people trying similar approaches to protein sequences. Transformers work better.