(Relay tech lead here)
It's in the privacy policy (https://www.mozilla.org/en-US/privacy/firefox-relay/), but yes - the emails are sent thru Amazon SES in plaintext.
We have kicked around the idea of enabling + preserving E2EE emails thru Relay, but ... it's tricky.