Palm-E: An embodied multimodal language model

Google AI have also published a paper to go alongside this: https://palm-e.github.io/assets/palm-e.pdf