HNHacker News
TopNewBestAskShowJobs

neilc

4,830 karma · joined February 26, 2007

CTO / Co-founder, Determined AI http://neilconway.org
submissionscomments
neilc··on Grid: AI platform from the makers of PyTorch Lightning
Congratulations to the Grid team on the fundraise and the announcement! Exciting stuff.

It seems like there is an emerging consensus that (a) DL development requires access to massive compute, but (b) if you’re only using off-the-shelf PyTorch or TensorFlow, moving your model from your personal development environment to a cluster or cloud setting is too difficult — it is easy to spend most of your time managing infrastructure rather than developing models. At Determined AI, we’ve spent the last few years building an open source DL training platform that tries to make that process a lot simpler (https://github.com/determined-ai/determined), but I think it's fair to say that this is still very much an open space and an important problem. Curious to take a look at Grid AI and see how it compares to other tools in the space -- some other alternatives include Kubeflow, Polyaxon, and Spell AI.

neilc··on Trump suspends H1B, H4 visas till year end
> H1B holders pay taxes for benefits they cannot receive like Medicare, social security, and a sleuth of federal gov programs?

H1B holders can actually receive social security benefits. See https://www.ssa.gov/international/agreements_overview.html

neilc··on WeWork founder will get $1.7B to let SoftBank take over his company
> Let's not forget that Enron, Theranos and WeWork propagated a form of corporate fraud

What aspect of WeWork was/is fraudulent?

neilc··on At 22 years old, Postgres might just be the most advanced database yet
> In code that truly embraces "Lispy" lists, you cannot switch to an encapsulated list representation without making substantial changes to the code.

I think changing the list representation made sense in part because the rest of the codebase didn't use lists in a deeply Lispy way, for the most part.

neilc··on At 22 years old, Postgres might just be the most advanced database yet
Yeah, we replaced the old Lisp-style List implementation with a different implementation a while ago: https://github.com/postgres/postgres/commit/d0b4399d81f39dec...

You can still see the Lisp heritage in a few places, but overall I wouldn't say Postgres is "literally lisp in C".

neilc··on PG&E stock plunged 32% after it disclosed a possible link to California’s fire
"Insurance policies for extreme weather-related losses -- especially for floods and for coastal wind damage associated with hurricanes -- are not priced to reflect the real risk ... as a result of government intervention in property insurance markets, through either rate regulation or direct government provision of subsidized insurance, private markets no longer generate price signals regarding the cost of living in severe-weather regions."

https://repository.law.umich.edu/cgi/viewcontent.cgi?article...

neilc··on Ask HN: Who is hiring? (November 2018)
Determined AI | San Francisco, CA | Remote (SF preferred).

We build software to make deep learning engineers dramatically more productive. Founded by leading experts in distributed systems and machine learning, our product is a complete ML environment that enables teams of DL engineers to share a GPU cluster, do efficient hyperparameter tuning, and train and deploy deep neural networks up to 100x faster than with state-of-the-art tools. We are well-funded and have significant customer traction.

The team is deeply technical and working at the cutting edge of modern ML infrastructure, but we also care about building practical technology that solves real problems for our customers.

We’re hiring exceptional software engineers to play a fundamental role in building the company and shaping the culture. We're particularly interested in

(1) Distributed Systems Engineers who are passionate about building scalable, reliable software.

(2) Full-stack Engineers who believe that building enterprise software doesn't mean that great UX is optional.

(3) ML Engineers with a strong algorithmic and statistical background, as well as hands-on experience building deep learning applications.

Tech Stack: Python, Go, Elm, Kubernetes, Mesos, Docker, TensorFlow/Keras/PyTorch.

Compensation: Competitive salary and benefits, meaningful equity stake.

https://determined.ai/careers/

neil@determined.ai

neilc··on Ask HN: Who is hiring? (October 2018)
Determined AI | San Francisco, CA | Remote (SF preferred).

We build software to make deep learning engineers dramatically more productive. Founded by leading experts in distributed systems and machine learning, our product is a complete ML environment that enables teams of DL engineers to share a GPU cluster, do efficient hyperparameter tuning, and train and deploy deep neural networks up to 100x faster than with state-of-the-art tools. We are well-funded and have significant customer traction.

The team is deeply technical and working at the cutting edge of modern ML infrastructure, but we also care about building practical technology that solves real problems for our customers.

We’re hiring exceptional software engineers to play a fundamental role in building the company and shaping the culture. We're particularly interested in

(1) Distributed Systems Engineers who are passionate about building scalable, reliable software.

(2) Full-stack Engineers who believe that building enterprise software doesn't mean that great UX is optional.

(3) ML Engineers with a strong algorithmic and statistical background, as well as hands-on experience building deep learning applications.

Tech Stack: Python, Go, Elm, Kubernetes, Mesos, Docker, TensorFlow/Keras/PyTorch.

Compensation: Competitive salary and benefits, meaningful equity stake.

https://determined.ai/careers/

neil@determined.ai

neilc··on Ask HN: Who is hiring? (September 2018)
Determined AI | San Francisco, CA | Remote (SF preferred).

We build software to make deep learning engineers dramatically more productive. Founded by leading experts in distributed systems and machine learning, our product is a complete ML environment that enables teams of DL engineers to share a GPU cluster, do efficient hyperparameter tuning, and train/deploy deep neural networks up to 100x more quickly than with state-of-the-art tools. We are well-funded and have significant customer traction.

The team is deeply technical and working at the cutting edge of modern ML infrastructure, but we also care about building practical technology that solves real problems for our customers.

We’re hiring exceptional software engineers to play a fundamental role in building the company and shaping the culture. We're particularly interested in

(1) Distributed Systems Engineers who are passionate about building scalable, reliable software.

(2) Full-stack Engineers who believe that building enterprise software doesn't mean that great UX is optional.

(3) ML Engineers with a strong algorithmic and statistical background, as well as hands-on experience building deep learning applications.

Tech Stack: Python, Go, Elm, Kubernetes, Mesos, Docker, TensorFlow/Keras/PyTorch.

Compensation: Competitive salary and benefits, meaningful equity stake.

https://determined.ai/careers/

neil@determined.ai

neilc··on Apple Will Start Paying Back Taxes to Irish Government Next Month
Ireland is not "enforcing" anything; the European Commission are the party that ruled that Apple received unfair tax treatment. Both Apple and the Irish government are appealing that ruling.

https://www.reuters.com/article/us-eu-apple-taxavoidance/ire...

neilc··on LLVM 6.0.0 Release
Apple's clang supports thread_local as of XCode 8: https://stackoverflow.com/questions/28094794/why-does-apple-...
neilc··on Amazon announces candidate cities for HQ2
> Amazon and those workers will still consume city services. City's don't make a profit on average

I'd be very surprised if an Amazon worker making, say, $160k consumes more in government services than the sales/property/income taxes they are paying.

neilc··on The Horror in the Standard Library
Can you link to some of the things you've read? What exactly is the "known issue"?
neilc··on AMD Ryzen 5 1600X vs Core i5 Review
Interesting -- do you have a link on this?
neilc··on AMD Ryzen 5 1600X vs Core i5 Review
> Linking is inherently mono threaded.

This is actually not the case -- modern linkers (e.g., lld) can take advantage of multiple cores.

https://lld.llvm.org/

neilc··on Hash indexes are faster than btree indexes?
Postgres hash indexes use linear hashing, which effectively means that rehashing/expansion is done incrementally: https://en.wikipedia.org/wiki/Linear_hashing
neilc··on Continuous Analytics Over Discontinuous Streams [pdf]
PipelineDB (YC W14) has a lot of similarities to the technology described in this paper, and is open-source: https://github.com/pipelinedb/pipelinedb

Disclaimer: I worked at Truviso; I know the PipelineDB guys but I'm not affiliated with the company.

neilc··on How Uber Used Secret “Greyball” Tool to Deceive Authorities Worldwide
It seems to involve the ethical dilemma of a radar detector.

It is similar, but I think an important difference is that Uber, as an organization, was deliberately flouting the law and also building tools to avoid suffering the consequences of that behavior.

I'd say it is similar to the difference between an individual using a radar detector for personal travel vs. a trucking/shipping company equipping all of their vehicles with radar detectors and making it a company policy to violate the speed limit.

neilc··on RethinkDB versus PostgreSQL: my personal experience
NOTIFY is transaction-safe: if the NOTIFY-ing transaction rolls back, the NOTIFY will not be delivered. See the discussion here ("NOTIFY interacts with SQL transactions in some important ways..."):

https://www.postgresql.org/docs/9.6/static/sql-notify.html

neilc··on Rust vs. Go
Channels are not network sockets; select cannot be used to wait on a set of network sockets.

(Early versions of Go had a "network channel" concept, but that was removed from the language: https://softwareengineering.stackexchange.com/questions/1540...)

neilc··on Many LASIK patients may wind up with glare, halos or other visual symptoms
From TFA:

> The results [of a previous study], published in October 2014, showed that some patients developed problems that adversely affected their day-to-day lives, such as difficulty driving at night or in sunshine. But it was such a small number — less than 1 percent — of the patients in the study.

> On Wednesday, the group released a follow-up report in JAMA Ophthalmology that provides more sobering information. The study suggests that the percentage of people who undergo LASIK and wind up with new visual symptoms — such as double images, glare, halos or starbursts — may be much higher.

> One interesting component of this study was that the survey showed that the percentage of people with symptoms may be much higher than what has been previously reported in studies involving direct interviews with health-care professionals.

neilc··on How the New York Times critic writes the reviews that make and break restaurants
Sure: something can be both overpriced and blue-collar. Think of the food you get at a typical football stadium, for example.
neilc··on Apple in talks with luxury carmaker McLaren
McLaren is privately held.

BTW, I'm curious which jurisdictions you're referring to.

neilc··on How the New York Times critic writes the reviews that make and break restaurants
> Pete Wells only reviews the fancier restaurants

This is not true; in fact, Wells is somewhat famous for reviewing more blue-collar restaurants, in contrast with previous Times critics. For example, here is his review of Guy Fieri's restaurant in Times Square: http://www.nytimes.com/2012/11/14/dining/reviews/restaurant-...

neilc··on Go 1.7 is released
This comment from one of the Go maintainers (Russ Cox) is relevant: https://news.ycombinator.com/item?id=8817990
neilc··on PostgreSQL Index Internals
This is a good summary paper on the database internals and major architectural decisions: http://db.cs.berkeley.edu/papers/fntdb07-architecture.pdf
neilc··on Re: Why Uber Engineering Switched from Postgres to MySQL
> a lot of the pain the Uber is feeling has to do with the way Postgres has implemented MVCC. Because they write new records all the time, they need to update all indexes, all the time

This is not true in general: there are circumstances where Postgres can skip updating indexes when a tuple is updated, assuming the update only changes values in non-indexed columns. See:

http://pgsql.tapoueh.org/site/html/misc/hot.html

https://git.postgresql.org/gitweb/?p=postgresql.git;a=blob;f...

neilc··on Microsoft to acquire LinkedIn for $26B
> In MBA-speak, "secular" means "non-cyclical."

It's not "MBA-speak"; this sense of the word "secular" is used in economics, time-series analysis, astronomy, etc.

https://en.wikipedia.org/wiki/Secular_variation

neilc··on Person carrying bacteria resistant to antibiotics of last resort found in U.S.
I think another factor is just intuition: taking medicine when you feel ill makes sense, but continuing to take the medication for several days after you feel completely recovered seems intuitively wrong to a lot of people.
neilc··on Twitter open-sources a high-performance replicated log service
This behavior should be fixed in Zk 3.4.7+ and 3.5.0+
← PreviousPage 2 of 34Next →