IIRC from the YT video in my top-level comment, it's dirt.
> I also wonder how well the sargassum bricks withstand weather.
dopa42365's comment (https://news.ycombinator.com/item?id=37176903) links a paper with the following claim:
> Studies carried out by the Secretariat of Ecology and Environment of Quintana Roo state, Mexico, found that the resistance of the bricks is 75–120 kgf/cm2, while its durability can be up to 120 years, regardless of the region or climate type where they are used (Desrochers et al., 2020). Currently there is no other sustainable material as resistant, or with such a long useful life. Sargabricks are therefore seen as a viable and safe material for the creation of ecofriendly buildings.
(edit: But the OP link also contains this 120y assertion. I haven't checked the paper's citations, so I'm not sure if everyone's depending on the cited study's analysis, or if that study is laundering claims by the people making the bricks)