In other places, it says pretty explicitly that there are other gods:
Pslams 95:3 ESV
For the LORD is a great God, and a great King above all gods.
Psalms 97:7 ESV
All worshipers of images are put to shame, who make their boast in worthless idols; worship him, all you gods!
Deuteronomy 32:8 NRSV (less henotheistic in other translatins)
When the Most High apportioned the nations, when he divided humankind, he fixed the boundaries of the peoples according to the number of the gods;
And there are others. We know pretty clearly from historical sources that the early Jews were henotheistic (recognized the existence of other gods, but only worshipped YHWH), and that is preserved in the oldest parts of the Old Testament. Even Genesis often uses a plural when God talks about his works - today that is often explained as talking about himself and the angels or even the holy trinity, but it is very likely it originally referred to the god of Israel and the other (lesser) gods in the heavens.