I think few languages have these two words. German, for example just uses "gender" as a recent loanword for the social construct and keeps using the traditional word "Geschlecht" for biological sex.
If it makes you feel any better, plenty of native English speakers find it difficult to understand or outright deny it.