I don’t think it is, since the HomePod needs to actually work for that connector to be useful. You may need to stick it back on to “fix” it, though.

It's not destructive, it's held by a few clips and glue. Use hot air to heat up the area and it snaps out.