Horseradish is spicy in the same sense as garlic is spicy, which is very unlike peppers.