Interesting.
I need to open a very large CSV file in Python, which is around 25GB in .zip format. Any idea how to do this in a streaming way, i.e. stopping after reading the first few thousand rows?
2 karma · joined July 24, 2015
I need to open a very large CSV file in Python, which is around 25GB in .zip format. Any idea how to do this in a streaming way, i.e. stopping after reading the first few thousand rows?
May I ask... do you ever construct information architectures (aka sitemaps) for your clients? If so, what tools would you use for this?
I was solidly in the "C++" column back then, but have since become a data scientist who now uses numpy/Python for all machine learning. That talk was a very interesting, helped me to understand what they're doing in my old field these days. Thanks for sharing.