Free tools to help with data analysis | Hacker News Reader

Free tools to help with data analysis

blog.brainstation.io

36 pointssalbowski13 comments

Low quality listicle SEO spam for their 'courses'. Submitter is abusing HN to spam nothing but links to their site.

Please avoid giving this kind of noise any attention or links.

I agree that this is very low quality. It is basically 5 of the names of 5 random tools with a generic description.

What is a good way to deal with low quality submissions on HN? We can't downvote and even posting on the link is a positive signal.

I usually comment and flag.

I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk!

https://datadojo.app

Interesting. Very nice to see live-updating of results like Excel.

Python fails on this transform function:

  def f(a):
      v = a if a >= 4 else 2
      return v

Message in red: "Error: (Brython compile error)"

Update: I recommend you try https://pypyjs.org/ for python in the browser.

Thanks! I’ll look into it. The reason I chose Brython was because it transpiles in the browser, so no server side compilation needed.

I looked into this more. The issue is, at least in a default input, a is an array type, so you need to either access a[0] or map over it. e.g. this works:

  def f(a):
    v = a[0] if a[0] >= 4 else 2
    return v

It looks like the main issue here is getting the correct compile error from Brython. Funnily enough this seems easier to do for the PySpark version :)

*Data

TLDR:

Anaconda - Python package manager

Rstudio - IDE

OpenRefine - data cleaning

Apache Airflow - programmatically author, schedule, and monitor workflows

H2O - Statistical and ML Algorithms