Yes, you should go back, but the real question is how.
I don't think it is a good idea to throw away all of your experience as a project manager. It seems to me you would do best to look for a hybrid position. Find a job where you would do some project management and some programming.
I'd look for a job at a small company, where their developers are used to wearing a lot of hats and don't require a full blown project manager. A place where the company could benefit from some reorganization as well as a programmer who can provide support to other devs by helping put out fires, put in code hours on projects falling behind schedule, and maybe build some prototypes.