HNHacker News
TopNewBestAskShowJobs

smortaz

1,711 karma · joined April 28, 2011

Shahrokh Mortazavi runs the Data Science Developer Tools teams at Microsoft, focused on Python, R, and Jupyter Notebooks (http://notebooks.azure.com). Previously, he was in the High Performance Computing group at Microsoft. He worked on the Phoenix Compiler tool chain (code gen, analysis, JIT) at Microsoft Research and, prior to that, over a 10 year period led Sun Microsystems’ Code Generation & Optimization compiler backend teams. Contact: smortaz over at microsoft.com
submissionscomments
smortaz··on Raddit: An open source alternative to Reddit
Uhhh... there's already a radd.it which is a nice viewer for reddit videos. people might get confused (or are these related?)

update: radd.it just shutdown. hmmm...

smortaz··on Strange Noise in Gravitational-Wave Data Sparks Debate
If you want to look at the data and run their code w/o installing any software, check out their ready to view/run Jupyter notebooks:

https://notebooks.azure.com/losc/libraries/tutorials

1. click on a notebook to see the html rendering 2. or clone+run to execute/edit the code (need to create login)

smortaz··on Benchmarking CNTK on Keras: Is It Better at Deep Learning Than TensorFlow?
If you havent tried CNTK and want to get an overview w/o installing anything, try:

https://notebooks.azure.com/cntk/libraries/tutorials

Cheers.

smortaz··on PyPy v5.8 released
We [msft python team] tried to get PyPy some funding, but it didn't go very far. I'll keep trying. We've also started this project to enable jitting for CPython:

https://github.com/Microsoft/Pyjion

The core of it is there and it's been accepted into the main trunk, but we haven't had the cycles to do quality codegen yet.

smortaz··on Show HN: Retool: Excel-like, with higher order primitives
Nice. This could use a 5 min video to show the flow + value-prop...
smortaz··on Getting started with the F# and .Net ecosystem
in case you'd like to get a quick intro to the language w/o installing anything, check out their jupyter notebook here which you can clone & run:

https://notebooks.azure.com/Microsoft/libraries/fsharp

smortaz··on LIGO Detects Gravitational Waves for Third Time
FYI - if you want to check out the data, the code, even an audio of the wave checkout:

https://notebooks.azure.com/roywilliams/libraries/LIGOOpenSc...

It's a Jupyter notebook that anyone can clone and run.

[edit: updated link]

smortaz··on How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
/team lead/

IANAL - but note that we also have Microsoft R (and enhanced version of CRAN R) which provides local multi-threading, and cluster level parallelization + distributed memory support. It and the stock R interpreter have lots of GPL code. And given that both R & Python are now integrated with SQL Server, it seems that the lawyers have become comfortable regarding the separation lines. SQL Server for example calls an external script for R/Python.

https://www.microsoft.com/en-us/sql-server/sql-server-r-serv...

https://blogs.technet.microsoft.com/dataplatforminsider/2017...

Thanks!

smortaz··on How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
Hi -

* It's possible - Anaconda comes with an MKL enhanced version of its math libs.

* There are multiple VMs, and each VMs hold multiple docker containers, one for each Library/user (library == collection of notebooks)

* Right now, no, but we are working on it. You can have a "prep" notebook where it readies your environment with !pip, !wget, ... etc. and then actual work notebooks. We'll soon have an initial "install.sh" that will be run upon start to run any prep steps you might have.

thanks!

smortaz··on How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
Your concern is valid. One easy way to avoid depending on a particular cloud's APIs is to either wrap them with your own, or just grab data from other neutral locations, such as github using !wget, requests, etc. There are pluses/minuses to each approach.
smortaz··on How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
Nice to see this on HN! For folks that don't know what this is... it's a free hosted Jupyter service, provided as a "thank you" to the Python, Jupyter, and general OSS community by the Microsoft Python team.

Regarding the perf #'s - just a heads up that you were probably on that VM all by yourself :). Though once enough people sign in or cpu threshold gets to a certain level, new VMs are allocated.

PS On a related note, we are wrapping up at PyCon in Portland, and one of the hit swags was the "Jupyter Notebook Notebook" :). See pics here:

https://goo.gl/photos/L9C4fq6AsPxU7bfq5

/disclaimer: team lead/

smortaz··on How Powerful Are Microsoft Azure’s Free Jupyter Notebooks?
Also, click on the Jupyter logo, then Select New, then Terminal, and you get a full bash prompt into your instance.
smortaz··on Eigentechno – Principal Component Analysis applied to electronic music
Very nice. Suggestion: Would be great to put the Jupyter notebooks on https://notebooks.azure.com so we can actually run/edit/play with them. Zot!
smortaz··on A Lap Around Python in Visual Studio 2017
/team lead/

Unfortunately VS for Mac currently doesn't support Python or R (the two languages our team supports). However, if you are interested, please file the request on uservocie - that really helps us convince mgmt.

Meanwhile, VS Code has pretty decent Python support which can be used on Windows, MacOS and Linux:

VS Code: https://code.visualstudio.com/docs/languages/python

uservoice: https://visualstudio.uservoice.com/forums/121579-visual-stud...

smortaz··on A Lap Around Python in Visual Studio 2017
/team lead/

Your fears regarding Python on Windows were quite justified. However, the world has dramatically changed, thanks in large part to folks like Continuum.io and their Anaconda distribution, Christoph Golke, and many other wheel providers.

Visual Studio actually provides an option to download Anaconda for you. It has a few hundred pre-built Windows pkgs ready to go. We also use it on our free jupyter notebook service and have been very happy with it.

UCI repo: http://www.lfd.uci.edu/~gohlke/pythonlibs/

Anaconda: https://www.continuum.io/downloads

Azure Notebooks: https://notebooks.azure.com

smortaz··on A Lap Around Python in Visual Studio 2017
/team lead/

Totally understand - Visual Studio can be somewhat heavy weight especially for basic editing. In that case, check VS Code's Python support. It's very lightweight and cross-platform:

https://code.visualstudio.com/docs/languages/python

smortaz··on A Lap Around Python in Visual Studio 2017
/team lead/

This is true, although IronPython is managed by the community and is doing well. Visual Studio supports IronPython, CPython, Pypy, ...

smortaz··on A Lap Around Python in Visual Studio 2017
/team lead here/

Thanks!

Regarding "Scientific" - we just added the Data Science Workload to Visual Studio 2017. Check it out here:

https://blogs.msdn.microsoft.com/visualstudio/2017/05/10/bui...

Basically Python + Anaconda, R + Microsoft enhanced R, F# with .Net as a single install. Python & R work with any interpreter, including IronPython & Pypy.

smortaz··on Jupyter Notebook 5.0
Hi, fair question. Lots of people are using the service in edu as well as commercial contexts. We haven't put any restrictions in that regard on it.

Other than that the plan is to keep this (or something similar) running as long as there is sufficient interest and so far there seems to be quite a bit!

Note that it does run on docker which means ultimately it's not fully "secure", but we hope to switch to hyperv-linux when it's available.

[smortaz at msft]

smortaz··on Wages rise on California farms, Americans still don’t want the job
palrewire, it would be great to have the notebook hosted on http://notebooks.azure.com so people can run it. thx.
smortaz··on Monte Carlo estimation of Pi
If for some reason you'd like to actually Run this notebook,I uploaded it to:

https://notebooks.azure.com/smortaz/libraries/MonteCarloPi

You can click on it, sign in to run, edit, etc.

Sign in: any outlook, xbox, hotmail, or msft ID.

smortaz··on Tour of F#
Hmmm... when I click on the Horses link, I see its 3 notebooks, with a blue clone & run button. When clicked, I get prompted to sign in (requires any msft account like outlook, xbox, hotmail, ...). Once you sign in (or create an account), you'll end up in Docker/Jupyter instance with the 3 notebooks. Clicking on the first one and doing a Run All, should give you:

http://imgur.com/a/JgcqP

What happens when you click the Intro to F# sample on the front page? It should render the notebook and if you clone, it should prompt to sign in as above. Hope this helps.

smortaz··on Tour of F#
A more recent Microsoft offering for trying F# (or Python, R) is:

https://notebooks.azure.com

Click on the Intro to F#. Or try the user contributed notebook:

https://notebooks.azure.com/library/HorsesForCourses

[msft]

smortaz··on Getting Started with Functional Programming in F#
Great video!

If you want to get an intro to the language w/o installing anything, give Jupyter notebooks a try - F# intro/tutorial:

https://notebooks.azure.com/library/fsharp/html/FSharp%20for...

(you can just browse it, or sign in to clone & run & edit & ... )

smortaz··on Show HN: Posters of Your GitHub Contributions
Is there a way to get these for a repo? I'd love order a couple for my teams. Thanks!
smortaz··on Bach's Holy Dread
Totally! Meanwhile, here's the magnificent Herr, unser Herrscher

https://www.youtube.com/watch?v=rIcinMxNYBc

smortaz··on Azure Jupyter Notebooks
[msft] Fair points jsjohnst. I don't have a good solution for you. Perhaps the teacher can setup one Microsoft account (eg school.outlook.com) and multiple ppl can use it? (but that comes w issues too sadly).

Perhaps www.code.org is a better offering?

smortaz··on Azure Jupyter Notebooks
[msft] Well, this is an honor - the creator of Jupyter commenting on this thread & not just any comment... but about embedding the Visual Studio Code editor in Jupyter Lab :).

Thanks Fernando, Brian, Min & team for everything you've done with Jupyter. Looking fwd to using Jlab soon!

s

smortaz··on Azure Jupyter Notebooks
[msft] RE Dropbox - Very sorry about that :(. We discovered an issue earlier and are feverishly looking at fixing it. Will remove the UI until it is fixed. Meanwhile you can !curl in data among other approaches.

RE Storage/CC sign up. I'll locate someone in that group & reply back.

smortaz··on Azure Jupyter Notebooks
[msft] Not sure. It's a hosted Jupyter Notebook service. A Notebook here is a polyglot, browser based, REPL on steroids.

See:

http://jupyter.org

Sample notebooks (html captures of runnable notebooks):

https://nbviewer.jupyter.org/

← PreviousPage 4 of 11Next →