Hacker News Reader

If anyone is interested in working on this (or other exciting Spark related things) @ IBM please reach out to me ( my HN username with the letter k removed at us.ibm.com )

View on HN

Has there been any work toward integration with IPython/Jupyter?

Getting IPython/Jupyter connected to Spark isn't hard.

I did it following a combination of these two guide:

http://ramhiser.com/2015/02/01/configuring-ipython-notebook-...

http://thepowerofdata.io/configuring-jupyteripython-notebook...

Edit, if this is interesting then... https://news.ycombinator.com/item?id=10496385

My team at IBM is developing a tool that integrates several key data science open source technologies all in one. It's called the Data Scientist Workbench (http://datascientistworkbench.com). It doesn't currently support SystemML yet, but it already integrates iPython/R/Scala with Spark, for example. The idea is to have all the tools you'll need for data analysis and visualization, in the cloud, directly accessible anytime from your browser. We plan to include SystemML in the future.

Reply on news.ycombinator.com