It is quite easy to change the input features as pixels and fit into convnet under Keras (That's why I love Keras so much). However, gym_torcs only support 64x64 pixels and it is hard to see by human eyes, IMHO.

https://github.com/ugo-nama-kun/gym_torcs/issues/4