How did you generate the embeddings. The vectors are relatively small for all the embedding I have seen built from image and nlp models.

Which copernicus bands were you using? Did you augment the data with DEM info?