alexott

No, it’s not just API layer, but significant addon on top of existing tech… It brings transactions, faster queries, time travel, etc.

Maybe you can look again - things are changing very fast, few years there were mo DBSQL, Photon, Delta Sharing, etc.

For blocking checks - I personally use notion of errors and warnings, with errors definitely going to quarantine and propagated to good data, and warnings going to both good data and quarantine. It’s a trade off between not blocking all data and having a visibility of what is potentially bad. Another approach is to send everything into quarantine, but then giving users an instrument for rescuing their data, and further tuning checks to avoid this happening.

I’m using 13 old iPod for one simple reason - its very handy for music and podcasts. Just set the play list “didn’t listen for N weeks” and music is automatically synced, listened podcasts are removed and new are uploaded, etc.

I would suggest to look onto Delta Lake (https://delta.io/) - it's built on top of the Parquet, but has advantages over the plain parquet:

- transactions - you don't get a garbage in your table if your write failed

- supports update/delete/merge operations (in some implementations)

- metadata allows faster discovery of data, for example, if you have a lot of partitions on the cloud storage.

- metadata also allow to support features like data skipping, when you can filter out files that doesn't contain necessary data

- time travel - you can get back to previous versions of the tables

For corporate customers it usually costs significantly less. Few years ago I worked in a very big company, and as I remember, O'Reilly subscription cost per person was < $50

I wish that it would happen in Germany :-( Even in current situation, government is reluctant to open existing stations

I like PlantUML a lot

Very often they go into product management roles

Yeah, language detection on short texts is quite complex. In my practice, N-grams doesn’t work well for them.

You can try with dataset that I’ve used to evaluate fasttext against different language detectors - it’s linked to this blog post: https://alexott.blogspot.com/2017/10/evaluating-fasttexts-mo...

I’ll try to find time to do it myself, but most probably only tomorrow

Thank you

it would be really useful to add release dates to this page...

Just a suggestion for site - separate language from currency. For example, for me it’s much faster to read in English, but I’m paying in euro…

Just in case, there is a Russian translation of this book: http://lisper.ru/pcl/

Manning is very different from other publishers - combination of all these roles allow to produce a high quality content… that’s make it different from other publishers - O’Reilly, APress, etc.

Primarily because it’s very hard to express complex conditions

magic database has its own problems based on the language itself

File was slower by at least 10 times slower (it was ~10 years ago).

Second thing, for example it didn’t work with compound objects. Especially for things like word embedded in excel, etc. Similar for XML-based types, zip-based, …

Plus rules aren’t very flexible - I’d used lisp-like language to describe detection patterns - that made it quite flexible in describing complex detection logic.

yeah, detection of file types is a fun. I worked on several implementation of very precise type detection (for use in email & web proxies), and there are so many low-level details that affect that detection. The biggest fun is detection of type for container-based file formats, like, OLE-based office files (office 95-2003), Zip-based formats (MS Office > 2003, OpenOffice/LibreOffice, jar/war/ear, ...) where you need to actually look into the file to determined the type. And to add complexity, the implementation should be very fast if you run inside the web proxy where type is detected for each request (at least twice for request/response stage, or more if you process an archive).

Extraction of content is a separate fun ;-)

There is also Apache Tika (https://tika.apache.org/) - file format detection & content extraction library

I also prefer to use Maven to compile Scala code - it's much faster, better integrated with IDEs, etc.

re2 has limited functionality. It’s works wel for specific patterns, like crawling, but not general purpose

MobilePay in Denmark: https://en.wikipedia.org/wiki/MobilePay

it's different - rxin talks about this: https://databricks.com/product/databricks-sql

when you run Python, it's on Spark, although you now can use Photon engine that is used for DB SQL by default

for DB that's old number - recent valuation is $38B

As traveling a lot on trains in Germany - it’s a joke. Trains are are late so you miss connections, cancelled on short notice, etc. I never know if get to airport on time when I use train. You can easily half hour late on 1 hour trip…

mostly in Germany...

Video ID verification works quite well in many cases.

I doubt about PayPal’s anti-fraud capabilities. They allowed to open another account with the same name and address as mine, but with different phone and email, without any confirmation. And that person bought something, and after it wasn’t paid, gave my information to collectors…