Hacker News Reader

gnewton77on Classifying all of the pdfs on the internet

This is a fairly accurate account of the roles played for this paper. I came up with the original idea, wrote all the code, did the analysis, and wrote the paper, with my colleagues providing input along the way. I did this when I was a researcher at the National Research Council Canada. Thanks! :-)

I just realized that the pre-print of the paper is available at the NRC's Publications Archive: https://nrc-publications.canada.ca/eng/view/object/?id=63e86...

gnewton77on Classifying all of the pdfs on the internet

Thanks! Yes, I'm sure using modern hardware and modern techniques would improve both computation time and results.

gnewton77on Classifying all of the pdfs on the internet

Did some similar work with similar visualizations ~2009, on ~5.7M research articles (PDFs, private corpus) from scientific publishers Elsevier, Springer:

Newton, G., A. Callahan & M. Dumontier. 2009. Semantic Journal Mapping for Search Visualization in a Large Scale Article Digital Library. Second Workshop on Very Large Digital Libraries at the European Conference on Digital Libraries (ECDL) 2009. https://lekythos.library.ucy.ac.cy/bitstream/handle/10797/14...

I am the first author.

gnewton77on Learn PostScript by Doing (2005) [pdf]

I've pulled together (yet another) list of useful various Postscript resources (books, tutorials, articles, etc) here: https://zzzoot.blogspot.com/2022/09/postscript-coding-resour...

gnewton77on A visual book recommender

The visualizations remind me of those in a paper I co-authored a while ago (2009) visualizing ~2400 scientific journal / ~5.7M full-text articles: "Semantic Journal Mapping for Search Visualization in a Large Scale Article Digital Library" https://nrc-publications.canada.ca/eng/view/accepted/?id=63e...

gnewton77on Open Sourcing Our Go Libraries (2014)

>Do you _think_ you need generics? then Go isn't for you.

FTFU ;-)

gnewton77on Fast, auto-generated streaming JSON parsing for Android

I've added an issue to chidley to generate these classes, in addition to the Java/JAXB classes it produces now: https://github.com/gnewton/chidley/issues/4

(Of course only for json generation from XML)

gnewton77on Chidley: XML to JSON Converter (Go)

Sorry, forget link: https://github.com/gnewton/chidley

gnewton77on Chidley: XML to JSON Converter (Go)

chidley creates Go structs from XML. It can also generate code for a Go program that will convert the given XML to JSON or back to XML. Works on huge files by supporting XML decoding streaming. Tested on 137GB wikipedia XML file (and many others). Handles XML namespaces. -Author

gnewton77on Majority of published scientific data not recoverable 20 years later

I made a great diagram which illustrates this here: '"Research Data and Metadata at Risk: Degradation over Time" http://zzzoot.blogspot.ca/2010/12/research-data-and-metadata... for a paper I co-authored: https://www.jstage.jst.go.jp/article/dsj/11/0/11_11-DS3/_pdf

The diagram is based on one from an earlier paper: 'Nongeospatial Metadata for the Ecological Sciences', 1997, Michener et al. http://dx.doi.org/10.1890/1051-0761(1997)007%5B0330:NMFTES%5...