I was thinking about working through the NLTK book once I'm finished with Bishop's Pattern Recognition, would you be able to recommend an alternative?
You can also check out the great online NLP course taught by the author and Prof. Chris Manning from Stanford: https://www.youtube.com/watch?v=nfoudtpBV68&list=PL6397E4B26...
and notes: http://www.cs.columbia.edu/~mcollins/
he talks about averaged perceptron at the end (Lectures on generalized log-linear models - GLM http://www.cs.columbia.edu/~cs4705/)
perceptron tagger code (hw4 solution) can be found here https://github.com/emmadoraruth/Perceptron_Tagger.git
You could try Hal Daume's blog, and Bob Carpenter's blog.
[0] http://www.amazon.com/review/R2FUAZHGUOERHV
[1] http://www.amazon.com/Foundations-Statistical-Natural-Langua...