HNHacker News
TopNewBestAskShowJobs

alexott

950 karma · joined February 5, 2009

you can find information about me at http://alexott.net/en/ and at http://alexott.blogspot.com

[ my public key: https://keybase.io/alexott; my proof: https://keybase.io/alexott/sigs/YGbMyjTEeMg-ketys_027-WJuGoEn-vKmE1jZ-213tQ ]

submissionscomments
alexott··on A plain-text file format for todos and check lists
I use beorg on iOS, and orgzly on android
alexott··on Ban Bottled Water: Microplastics Reside in Them Globally
In Germany you pay 25 cents for recyclable bottle or 15 for reusable bottle…
alexott··on Ask HN: Are Linux HowTos dead? Why?
Imho, the reason for it is that now we have much more sources of information. How tos were a concentrated pieces of information distributed with Linux distributions or via slow mediums… 20+ years ago I was involved 8th Russian translation of many how to’s and they were used because there were no other sources of information, but now you can just translate almost any page to language that you need
alexott··on Germany sees shift in sentiment toward atomic energy
My official study was in the area of uranium enrichment. The situation in Soviet Union was always following - mostly Kazakhstan, Uzbekistan, Tajikistan mined the raw uranium and did first enrichment pass (I grew up in one of that areas), and then final enrichment was done in Russia. I’m not involved into that anymore for more than 20 years, but I doubt that situation has changed significantly as it requires significant capital investment, plus know-how…
alexott··on Retirement of Amazon MOBI eBook file format
At least author title and cover is kept - I’ve sent few books few days ago. There was a period when it didn’t handle them well when sent via email, but they fixed it few months ago
alexott··on Retirement of Amazon MOBI eBook file format
I downloaded send to kindle this weekend trying to upload file bigger than 25mb tgat I can’t send by gmail. It didn’t accept ePub. I ended by using calibre to send it as email
alexott··on Implementing a Zero Trust Architecture
I met customers who put anything under that umbrella. And they want to use PaaS/SaaS products - like, you need to encrypt table names, or some unrelated data… Some companies just use that to protect their …
alexott··on Using A Very Old Machine
I’m doing the same - if it works, why to do an upgrade?
alexott··on Using A Very Old Machine
I’m using 10 years MacBook (not retina) as home computer - it has 16gb memory and 2tb ssd. And works quite good for web browsing, writing documents, even for some development (like patching Spark Redis connector, although it’s usually augmented by separate Linux desktop). Maybe I’ll upgrade at some point, but it’s still good for many tasks. The only problem is Mac OS version :-(
alexott··on How far can you go by train in 5h?
I can’t say that’s accurate. For my area it shows that Kassel is 3 hours away, although direct train goes in less than an hour, and even with intermediate stop, it’s slightly more than an hour. South of Germany isn’t connected at all, although I can get to Ingolstadt in less that 5 hours…
alexott··on Twenty years of Valgrind
I also heavily used callgrind/cachegrind to tune critical paths in our high performance web proxy, we’re each micro/milliseconds counts… For example, in media type detection that is called multiple times per request (minimum twice for request/response), etc.
alexott··on Tom Lord has died
Unfortunately yes. That was interesting system before git…
alexott··on No Language Left Behind
Twitter may not be representative imho because of the short text. It should first come to a problem of reliable language detection, and Twitter is quite often wrong there
alexott··on Build your own GitHub Copilot with Salesforce CodeGen AI [video]
Go worked quite well…
alexott··on Diagram as Code
What is the advantage over PlantUML, for example? Only syntax?
alexott··on Comparison of Data Lake Table Formats (Iceberg, Hudi and Delta Lake)
Apple uses Delta: https://databricks.com/session_na20/patterns-and-operational..., similarly Disney+: https://databricks.com/p/webinar/unlock-the-potential-inside..., and hundreds other companies (https://databricks.com/customers)
alexott··on Show HN: Terragen.dev – Automagically Generate Terraform for AWS
That's great stuff! We have exporter functionality in the Databricks Terraform provider [1] and a lot of customers started to use Terraform for existing Databricks resources because they don't need to re-implement everything manually - just point to workspace, and wait few minutes.

[1] https://registry.terraform.io/providers/databrickslabs/datab...

alexott··on ClojureDocs – Community-powered documentation and examples for Clojure
You can also look onto this book (still in progress): https://www.manning.com/books/clojure-the-essential-referenc... - it tries to explain the standard library with examples, etc.
alexott··on Webscraping Proxy Library for Scrapy
You may also look to this project: https://github.com/nfx/slrp - rotating open proxy multiplexer
alexott··on Germany is offering a summer of cheap trains
DB is nightmare. I had so many cases of missing trains when they had 1 hour delay on 1.5h track, connecting trains no waiting even for 5 minutes, cancelling train in last minute, etc.
alexott··on Building a threat intelligence feed using the Twitter API and a bit of code
Maybe for threat intel it wasn't very useful, but when I worked at McAfee 6-7 years ago, I've heavily used Twitter as a source of new sites for URL categorization (content-wise) - it was very useful to get trending stuff, etc., and proactively put classification into URL database
alexott··on The end of big data
It could be a good second step, imho…
alexott··on The end of big data
For short intro I would point to “Learning Spark, 2ed” - it was available for free from Databricks site (maybe still available, look via Google) - it gives intro into the Spark and Delta Lake. The “Data Analysis with Python and PySpark” is a bit deeper, but doesn’t cover Delta.
alexott··on The end of big data
It became better
alexott··on The end of big data
No. Azure Databricks is a first class service - officially its a Microsoft product. With all UIs, diagnostic logging, encryption, consolidated billing, etc.
alexott··on The end of big data
https://delta.io/blog/2022-05-05-delta-lake-1-2-released/ - big part is open sourced and more is coming (see roadmap on GitHub: https://github.com/delta-io/delta/issues/920)
alexott··on The end of big data
And some queries, like, max(col) could be answered without touching the data…
alexott··on The end of big data
Regarding performance- try version 1.2.x or higher - it includes data skipping, etc. from what was Databricks-only implementation before.

Regarding “that’s all” - can you give an estimate how much time it will take to reimplement it from scratch on multiple cloud platforms?

alexott··on The end of big data
Databricks includes pure SQL implementations - Databricks SQL, for example. Or for example, Delta Live Tables allow to write you pipelines using only SQL…
alexott··on The end of big data
There are a lot of optimizations in query engines as well - results cache, local caches of files stored in cloud, data layout optimization and skipping (to avoid reading not necessary files), etc.
← PreviousPage 3 of 10Next →