HNHacker News
TopNewBestAskShowJobs

hulahoof

580 karma · joined December 5, 2015

Field Engineering @ Databricks
submissionscomments
hulahoof··on Be wary of imitating high-status people who can afford to countersignal
For anyone not from aus the Betoota is a (great) satire publication similar to the onion
hulahoof··on Japanese have been producing wood for 700 years without cutting down trees
It’s somewhat sad to read that after 1430 years being family run the oldest company on this list went into liquidation in 2006 and was acquired
hulahoof··on US Prosecutors Opened Probe of FTX Months Before Its Collapse
https://archive.ph/Ti1iu
hulahoof··on Map of the Internet
It's astonishing that N.A. has over half of the IPv4 allocations! My country doesn't even appear until zoom level 5
hulahoof··on Binance to acquire FTX
This is true for Eth, but there are many chains where DeFi exchange transaction fees are a rounding error
hulahoof··on It is time to legalise cocaine: The costs of prohibition outweigh the benefits
Not sure about GP but I’m in aus and can confirm the Coke is that bad
hulahoof··on We Burned Down Players’ Houses in Ultima Online
FFXIV has a decent gathering approach
hulahoof··on Porsche boss faces software woes keeping VW a step behind Tesla
As an Australian I agreed with your comment, but the link you shared indicate that petroleum actually is a larger export for us

> The top exports of Australia are Iron Ore ($79.6B), Coal Briquettes ($36.4B), Petroleum Gas ($26.8B), Gold ($17.7B), and Frozen Bovine Meat ($4B)

hulahoof··on US Government Bans Export of Nvidia A100 and H100 GPUs to China and Russia
Maybe the point is just to prevent shortages
hulahoof··on Search over 5M+ Stable Diffusion images and prompts
I was just wondering this, does including his name have the same effect as the trending on art station stuff ?
hulahoof··on Patent Trolls Inbound: Our First Lawsuit
What a wild story. Complete with diss track towards Sony[1].

[1] https://www.youtube.com/watch?v=9iUvuaChDEg

hulahoof··on Perfluorocubane is (as you would expect) weird
Ignition! is one of my all time favourite reads, that I picked up from a previous comment similar to this - highly recommend if it piques the interest of any passer bys
hulahoof··on The Google Pixel 6a highlights the problem with the U.S. phone market
While the 3.5mm headphone jack is only ~70 years old [1], the quarter inch jack has it's roots in the late 1870's [2].

[1] https://en.wikipedia.org/wiki/Phone_connector_(audio)#Miniat...

[2] https://www.bbc.com/news/magazine-35253398

hulahoof··on Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf]
> Netflix recommendations seem crap because they don't have a lot of third party content to recommend in the first place.

Their recommendations used to be world class until they got rid of the user feedback mechanisms.

hulahoof··on Physics duo finds magic in two dimensions
When they mention tearing them in half, I’d imagine this more closely resembles what we would think of as slicing and just has the tearing effect due to the size of the material
hulahoof··on Man who robbed bank to get his own money back hailed as national hero
Give a man the world and he will rob himself
hulahoof··on $5.6B cloud company Fivetran acquired its way to survival
A lot of people use databricks for the analytical and ML workloads (leveraging it as a sort of extended spark environment)
hulahoof··on We're improving search results when you use quotes
I find DDG to be better than anything other than finding local stores, but I just use (google) maps for that anyway.
hulahoof··on James Webb first images – complete set of high resolution shots now live
I mean, you may think it's a long way down the road to the chemist, but that's just peanuts to space.
hulahoof··on Arizona makes it illegal for bystanders to record cops at close range
Seems like a great way to prevent recordings by having one officer move towards onlookers and force them an arbitrary distance away
hulahoof··on Cloudflare had a partial outage
Agreed, NSA is much more likely
hulahoof··on Birds Aren’t Real took on the conspiracy theorists
I can’t find the exact video but I have seen similar to these in videos from military expo’s

https://www.thedronebird.com/aves/

hulahoof··on A project with a single 11,000-line code file
I would expect people new to the code base would look at this gigantuan file and ask why it hasn’t been refactored, and this probably was seen as an opportunity to familiarise new hires with the code base as well as get them on the same level as to the effort involved in a refactor.

I agree with you, a rewrite is probably how they should have tackled this one.

hulahoof··on Consciousness is supported by near-critical slow cortical electrodynamics
That sounds really interesting and I have not heard of this before, where would you suggest to start reading into surgical sedatives?
hulahoof··on The Unbundling of Airflow
I don't think you are missing anything, but allowing DBT to contain all the models that make up your various pipelines and reference each other mean that you can schedule your various pipelines at different cadences and use tags to refresh the relevant DBT models from a single code base.

It sounds like in your approach this would be writing this dependency logic into each DAG you schedule on airflow.

In the same way you would interpolate your jinja SQL before copying it into the database, you would use dbt compile or the output from a dbt run from the target/ folder and copy that SQL into your DB console or to share.

EDIT: This means your T is a single airflow node in each DAG, though I then still use airflow for the E/L tasks around it

hulahoof··on The Unbundling of Airflow
This reflects how I often deploy Airflow as well (usually on GCP as Composer)

We use DBT to manage the DAG for the BQ transformations, put this in a container and deploy it into the kubernetes cluster that airflow is running on as a single node.

Airflow can then handle the scheduling and DAG nodes for non DWH dependencies such as loading/checking for files, kicking off tasks that need to run after the DWH refresh and the like.

I find once it is set up it is extremely easy for small teams to follow the pattern, and the single view of all the pipelines running is a great benefit - as well as handling the logic around last successful runs etc., that would need to be implemented manually if using simple cron jobs.

hulahoof··on The Casio employee behind the “Sleng Teng” riddim that revolutionized reggae
Because you let the high frequencies pass through on a high pass filter and vice versa
hulahoof··on Student photographs people with hidden spy cam in the 1890s (2018)
Or alternatively “the featured article” is common
hulahoof··on Buying Influence: How China manipulates Facebook and Twitter
> You'd think, as a billionaire they have a plane waiting for them 24/7 to get out of the country.

I guess disappeared could mean they are on a beach somewhere under an alias, but I don't think we can assume that for all of them

hulahoof··on The secret Uganda deal that has brought NSO to the brink of collapse
But Israel isn't a part of any of those agreements, it would be just as likely they spy on the US via a direct partnership with US agencies
← PreviousPage 2 of 10Next →