tetron

Curoverse (a Veritas Genetics company) | Boston, MA or REMOTE | https://curoverse.com/about

Veritas Genetics is at the cutting edge of direct to consumer whole genome sequencing. Come work on the open source Arvados (https://arvados.org/) platform for cloud-based management of petabytes of genomic data and bioinformatics workflows. Our key technologies include Go, Python, Ruby, TypeScript, Common Workflow Language (CWL), Docker. No biology background needed.

Curoverse (a Veritas Genetics company) | Boston, MA and remote

Work on the open source Arvados (http://arvados.org) platform for storage & analysis of biomedical big data, used by major biotech & pharma companies. Small team, relaxed work environment, work on software that supports researchers working on the cutting edge of precision medicine and drug discovery. Hiring all positions in engineering and operations, Linux/Python/Golang.

https://curoverse.com/about

Schemas and validation for YAML (and JSON):

http://github.com/common-workflow-language/schema_salad

Or maybe certain professions have a limited number of openings, which tend to go to people with connections, and cooincidentally these professions deal with large amounts of money, so taking 1% commission on a hundred million dollar deal for very little work seems reasonable.

Agree that Microsoft would be a plausible buyer. They have deep pockets, have hired ex-Docker engineers such as Jess Frazelle on the Azure team, and are investing heavily in the capability to run Linux-based Docker containers seamlessly on Windows. However, they still need to persuade people to use their stack. Aquiring Docker-the-company is the sort of thing Microsoft would do to buy their way into the market.

Some of these responses speak to the difference between "programming" and "software engineering". If you want people to hack code without regard for what it is for, you get programmers. If you want a team that is fully engaged in building a product (which means the whole life cycle from requirements to deployment) you need software engineers. If you disempower developers from that kind of decision making, it doesn't matter what their title is.

Incidentally, Arvados (http://arvados.org) is the software used to host the Harvard PGP data, and is a free software platform for managing large scale storage and analysis aimed at scientific workloads.

Blender is very much the Emacs equivalent for 3D editing software. It had a kernel of functionality written in C but the majority of the functionality is actually written in Python, which means there is really robust support for extensions and plugins.

Also like Emacs, the UI changes based on what mode you are currently in, which is super confusing at first because it is often not clear which mode you need to be in to accomplish some operation.

Also like Emacs, they have managed to cram an amazing amount of functionality into the program so it seems to do everything, and is rock solid (it would never crash, when 3DS Max would crash 3-4 times a day).

It's not for everyone, but it is very powerful.

I haven't used the new Azure cli, but a major issue with the node.js based cli was that it was heavily oriented towards interactive use and not well suited for use by scripts. Hard to parse output, prompt for parameters instead of accepting them on the command line, etc.

Common Workflow Language http://commonwl.org is a spec (with multiple implementations) for wrapping command line tools (which may run inside a Docker container) as functional units.

Curoverse | Boston, MA | on site or remote | full time

Open source startup developing the GPL Arvados (http://arvados.org) (https://github.com/curoverse/arvados) platform for massive scale storage and processing of biomedical big data. Seeking experienced software developers and devops to join our team. We are polyglot programmers who like hacking on distributed systems and learning new things, currently using Go, Python and Ruby.

Hiring process: phone screen, coding assignment, in-person interviews with the team

https://curoverse.com/about | https://curoverse.com/jobs

http://github.com/common-workflow-language/schema_salad is another schema language for JSON & YAML based on Apache Avro.

Try https://github.com/rabix/cottontail

After Arvados (http://arvados.org) Toil has the most complete support for the common workflow language http://commonwl.org) which is an emerging standard for writing portable workflows that can run on different platforms, instead of being tied to a particular engine or grid/cluster/cloud technology.

(Toil contributor here)

Workflow systems are generally used to orchestrate parallel batch jobs on a cluster, which may have hundreds or thousands of individual tasks. So the emphasis is on defining what units of work are independent that can run on separate nodes without needing to communicate with other tasks, and how outputs of one task feed into the inputs of another.

Yes, that's right. I would also add data provenance, eg where did a data set come from and how it was computed. This flows directly from the features I mentioned of content addressed storage and recording compute job history.

There's several features that make Arvados unique.

* The content addressed storage system references hashes all data so you can unambiguously reference an immutable data set, similar to git but capable of handling huge invidual files (hundreds of gigabytes) and scaling to petabytes.

* Every compute job is recorded in a database with hashes identifying the inputs, Docker image, and outputs, so re-running past jobs is easy.

* Designed to federate multiple instances, to support both "hybrid cloud" setups within an organization, and allowing different organizations to share data.

These are all features that are particularly important to the bioinformatics community, but solve problems that are common to lots of informatics big data problems.

Hello all, Arvados developer here to answer your questions.

Going one step further, using http://CommonWL.org you can wrap Dockerized command line tools into callable Python functions, and abstracting all the details of stdin/stdout redirection and getting files into and out of the container.

Basically, designers have to put up with the same management bullshit as developers, except with significantly less respect for the difficulty of their craft.

This is basically the architecture of Arvados Crunch: http://arvados.org

Buying those 600,000 drives is probably only 10% of your costs, you need to run a data center if you want to actually use that data.

Also analysis pipelines generate intermediate results that are also large, and data is stored with 2x or 3x redundancy. So that 100GB might be more like 300GB once you factor in robust storage and bioinformatics.

Someone has, it is called dtrx ("do the right thing extractor"):

http://brettcsmith.org/2007/dtrx/

The Arvados project https://arvados.org/ is an open source scale-out storage and compute platform designed to address the needs of huge data, like genomics.

The Common Workflow Language https://common-workflow-language.github.io/ is an open source effort to create a common way of defining portable, reproducible computational workflows to address the needs of the science community, but could have broad application to business task automation as well.

My startup recently moved out of a WeWork location. The biggest problem I had with WeWork is that they treated their tenants a lot like Facebook treats it users: you are their product, not their customer. Some annoyances:

* A new "community manager" every 2 months. Either they move people around on purpose, or they had a lot of turnover, but either way it was confusing. Community managers ranged widely from "stickler for the rules" to "happy hour several times a week" to "invisible".

* Relentlessly flogging the mobile app, despite the fact that it the Android version crashed immediately on most phones.

* Daily spam of "top comments" from their wannabe social networking site, because I what I really want every day is to read about how the printer on the 3rd floor of the New York office is out of paper when I'm located in Boston.

* Hipster artwork that's funny the first time you see it and dull and juvenile the 50th time you walk pass it.

* Hipster furniture that's incredibly uncomfortable (because plush conference room chairs can't possible compete with a mismatched set of "retro" chairs apparently found in a junk shop.)

* Insufficient conference rooms, telephone booths and bathroom stalls

Of course, our location may be especially poorly planned/designed/operated, but the general target market seems to be the 20-something male unattached hipster entrepreneur with a "lifestyle startup"; if you're trying to get real work done you don't need all the petty distractions, so I'm not sure how durable the appeal of WeWork actually is.

Curoverse, Inc is hiring for full stack developer position, come work on Free Software for the next generation of Big Data analysis for genomics and beyond:

http://curoverse.theresumator.com/apply/0SFTJO/Senior-Softwa...

Also Arvados Keep (http://arvados.org) is a content-addressed distributed file system.

Gogs (https://github.com/gogits/gogs) is a rather nice up and coming alternative to gitlab for self hosted repositories.

This looks more or less like a reskinned Standard ML. Which is cool, because SML is awesome :-)