To describe Buddha as a secularist would be projecting our modern values onto a man 2500 years ago.

Reincarnation, the soul, karma, etc aren't exactly compatible with materialistic secularism.