Create a color fence. You can create a polygonal fence that describes your preferred color set and calculate an intersection from the hue value in HSV. If my hue is 320, then I could find a nice shade of orange/red along the polygonal fence. This should give you controlled useable colors. The intersection length is the value, and you could store variable saturation on the fence points if you want to control the level of saturation.

https://www.evernote.com/shard/s6/sh/c48da69a-7056-4ee0-9bcf...