Hacker News Reader

datascientiston Gene Hackman has died

Mississippi Burning is one my favorite films https://en.wikipedia.org/wiki/Mississippi_Burning

datascientiston [dead]

alternative link: http://archive.today/PJIHr

datascientiston Ending our third party fact-checking program and moving to Community Notes model

https://gradientflow.com/the-moderation-dilemma-a-balanced-l...

datascientiston DataChain: DBT for Unstructured Data

How does this relate to https://github.com/lancedb/lance

datascientiston The Open Source AI Definition RC1 Is Available for Comments

also see https://gradientflow.com/open-source-principles-in-foundatio...

datascientiston The Dual LLM pattern for building AI assistants that can resist prompt injection

Alignment is hard: "If the LLM has finite probability of exhibiting negative behavior, there exists a prompt for which the LLM will exhibit negative behavior with probability 1." Source: Fundamental Limitations of Alignment in LLMs https://arxiv.org/abs/2304.11082

datascientiston Laion-5B: A new era of open large-scale multi-modal datasets

Creators of the data quality tool for computer vision, fastdup, continue to improve on their free release https://github.com/visual-layer/fastdup

Here's a short video of some recent results for LAION 400M https://www.youtube.com/watch?v=dlRCm29Upu4

datascientiston Airflow's Problem

Recent perspectives from the creators of Prefect, Dagster, Flyte, and Orchest => https://gradientflow.com/summer-of-orchestation/

datascientiston Comprehensive Guide on Data Visualization with Pandas

If you need to scale out or speedup pandas, there's Modin https://modin.readthedocs.io/en/latest/ (which uses Ray from)

datascientiston Neural Networks, Manifolds, and Topology (2014)

Gunnar Carlsson will be teaching a related tutorial ("Using topological data analysis to understand, build, and improve neural networks") on April 16th in New York City https://conferences.oreilly.com/artificial-intelligence/ai-n...

datascientiston Building an AlphaZero AI using Python and Keras

RISE Lab's Ray platform (now includes RLlib) is another option https://www.oreilly.com/ideas/introducing-rllib-a-composable...

datascientiston PyTorch – Tensors and Dynamic neural networks in Python

Chainer's Define-by-run apporach is also described here https://www.oreilly.com/learning/complex-neural-networks-mad...

datascientiston Ask HN: What's the state of the job market in data science and machine learning?

A few months ago Mikio Braun wrote a great post on this topic (the need for data scientists with strong software development skills) https://www.oreilly.com/ideas/what-is-hardcore-data-science-...

datascientiston Gigaom Closes Down

O'Reilly Radar

datascientiston Mining Time-series with Trillions of Points: Dynamic Time Warping at scale

Here is a link to their C++ code: http://www.cs.ucr.edu/~eamonn/trillion.zip