your conception of RNN as a magic bullet is sorely mistaken.

for something like a meaningful name for a colour requires far more learning, data and context than is reasonable...