teraku

If you do not have all your stuff in AWS, and are not sure if you want to pay high amounts for managed or "serverless" solutions, I am currently developing a standard[0] for workflows and a distributed scheduler which is compliant to this standard. It's still WIP, but I've used my fair share of managed solutions, "serverless", open-source (Airflow/Luigi) and BI engines to wonder, why there is no general standard just for the definition of the workflows. So that moving between systems is much less friction...

[0] https://github.com/OpenWorkflow/OpenWorkflow

That sounds really interesting! I currently work on a side-project which is a distributed application and I plan on incorporating kubernetes/cloud-native into some of the core concepts, so I will check it out once I'm at this part of the implementation!

WSL is just horribly slow for me. So I use Linux exclusively at home, but my work mandates Windows (although we now allow Mac, and with my next hardware change I might just switch over to Mac). So to get into the comfort of my trusted toolchain I use WSL at work. Our company lags behind windows updates, since they only install "trusted" versions, whatever that means, and thus I still have WSL1. I heard WSL2 brings a lot of performance improvements. And I really hope it does, WSL1 is soooo slow. Especially compared to my home setups. The friction is just so high still. So I believe if you come from Windows and want use Linux tools with WSL, I think you might find it comfortable for some, but it's a horrible introduction to Linux, since a lot of it will be slow and you'd think "oh Linux is just as bad as Windows, I'd rather stick to my guns".

What? I have a ~1k LOC program which consists of 4 modules, 3 of them all importing the 4th and in total ~200 dependencies. With a warm cache my program takes ~2s to compile. Cold-cache is about 18s

Exactly this! I use Go because it's easy when I sometimes need to provide small binaries to colleagues to help with their day-to-day work. And those are colleagues who don't have a Python environment installed or anything, which I'd be opting for in small "workflow improvement" cases like this. So whip up a small Go program, compile to Windows, and make a colleague happy. But when I build larger codebases with my developer colleagues (or private projects at home) I really prefer Rust as it gives me so much more trust in the code that I might have to maintain for years and where the linecount is not just <200, but actually thousands and thousands.

I think it's a bit of a shadow argument. So for business, the logic goes: Goal := save(Money). time(Developer) := costs(Money). Therefore, to achieve our Goal, we optimise developer time.

But more often than not, businesses don't know how their developers spend their time. So as such, they optimise for results. The business doesn't care how you spend your time, as long as by the end of Sprint/Deadline/Whatever you have a result and/or a reason why not. And I'd bet some money that the reason will very rarely be "my compiler took to long".

From a developer standpoint, I understand better (mainly because I'm a developer). But it still lacks a bit: So I started using Rust and I have a long history with C. The first compile with Rust takes very long (because of loading all dependencies), but afterwards it is slower than C, but it's okay. In return you get a lot of extra safety for your program, it's basically time you spent on your C program to fix all those nitty gritty memory safe optimisations and making sure there's no dangling pointers and free(NULL) errors. Of course with experience, these get less and less, but there's always risk. Nobody is perfect.

For me as a developer, it's more of a shift in my thinking - which is, to be fair, hard to enforce on people and can only come from oneself. But now that I have a compiler which supports me handling memory and pointers, my mind is more at ease. It does these things I spend time debugging on for me (most of them, not all) and in return for longer compile time, I save development/debugging time. At first it feels a bit less productive, since you are just sitting around watching your compilation (there's an XKCD for that https://xkcd.com/303/), but you could also spend this time writing documentation, reading up on something or just grabbing your coffee (or leave the office and check in tomorrow). Things you would do anyways, it's just a matter of how you mentally approach it.

I think the downside only comes when you want it to be negative, or when you're still transitioning.

Don't actually work for you (not plan to) but I follow Han Xiao on Github and he is doing splendid work. Keep up the good work on the OSS front!

Did the same and told them why

While I agree with your general point, I think livestock is more heavily bred. Chicken, cows, poultry and pigs that "live" in factory farms nowadays can't even survive out in the wild, nor do they have particularly long life-spans.

This reminds me of https://xkcd.com/1425/

I think of it like, 7 minutes per day is 49 minutes of sports a week. And a steady, long-term effort has greater effect on the body than bursty, short-term efforts.

Although personally I aim for 15-30 minutes a day if I can only do minor workouts or 1-2h every other day if possible.

Oracle

Or like my colleagues: find behaviour that 99 out of 100 db-people find intuitive weird because it's not like WhAt ThEy ArE uSeD tO

Not really, just use Apache Beam and set the runner to whatever you have / prefer

So the main issue with Spark is that the streaming is not that great. In general a Spark cluster persé is not bad, but I see more and more people using Apache Beam and then just use a runner that either they already have or that fits them best. https://beam.apache.org/

Spark being an example of a tool that (also) exists inside the Hadoop ecosystem and is still gaining acceptance due to popularity, but at the same time losing traction as better option are arising.

Not A/B testing, but not showing the original link is illegal in the EU.

It's illegal to do that in the EU, so probably only affects non-EU terretories.

I've been using Synergy[0] in the past, but I eliminated the use-case for me. Only have one machine on my desk nowadays. It's commercial but works like a charm.

This here looks very promising, but since I already have a license and no more use-case I'm a bit bummed I can't/won't check it out..

[0] - https://symless.com/synergy

You said it's not your experience, but then you give an anecdote which says where because fast writing was prioritized, he ended up with runtime errors...

I never have issues with my Python environments, and I use either requirements, venv or pipenv, depending on the project.

And I use it on Windows and Linux, server and desktop. You might be interested in: https://snarky.ca/what-the-heck-is-pyproject-toml/

I had this exact thing happen to me yesterday. I copied a function header from GitHub and searched in GitHub search for it to find the declaration. No results. Clonsed the repo, and clicked "Go to declaration" in my IDE bum "you have reached your destination". Wtf?

Well, he is not wrong. The words he chose were morally charged, but at least the "narcisstic tendencies" I think you can just take it as it is.

And it's not bad to sometimes just think about yourself. It's just when it becomes a self-fulfilling prophecy "I need status/affirmation in order to feel fulfilled" that it's shifts towards being obnoxious.

This. I remember there being articles about Neandertals having almost no curious explorers, being very catious, whereas homo sapiens skeletons found in swamps, with deadly mushrooms in their stomach and whatnot. So even though Neandertals had a more advanced brain during their time compared to the homo sapien competitor, they died because they did not make it, maybe because they did not take enough risk.

I think they could find funding and use-cases, if they had something like lincensing and terms of use backed into data to track lineage. E.g. "this columns contains emails" and is revokable. Or when you publish data, "this column needs hashing/anonymizing/...". And if you track data across versions and can version relations, you can create lineage.

Overall seen many of these lately, waiting for one to really shine. But not because I think it's a grand problem, as I can version my DDL/DML even/code, but I see some need for it because I have a lot of non-tech people working with data throwing it left and right and expecting me to clean up after them.

This. I use a bag free (manual) vacuum and I even though I can manage it without water and not create too much airborne dust, if you just spray water it slightly it will stick to eachother and become big balls.

Don't go low-carb. There is no need, it's not unhealthy. Especially if you are sporty (as it sounds).

The current state of affairs is: If you are insulin resistant (either because of genetics, obesity, whatever) then having a low-carb high fat diet is better for you. If your insulin resistance is high, then your pancreas produces much more insulin, meaning your cells will start storing energy instead of using it up. If this keeps up for a long period, your fat tissues, which are supposed to be your fat/energy storage, will fill up and your body (or rather the particles transporting the transformed sugar from the liver) will start sticking to your organs. This starts inflammations and makes your organs weaker, and in turn also raising your insulin resistance. And these malfunctions also spread to the brain and can cause alzheimer and the like. The exact chain of effects is not yet confirmed, so from here on it's a lot of speculation. But if you now are trying to lose weight, and you just reduce calories, but keeping a "high-carb/low-fat" diet, then you will be hungry. Because either you have too little protein to feed yourself, or you eat enough protein and you automatically eat too many carbs again, producing more and more insulin. This is how high-fat diets come in handy, as they don't spur liver activity and don't impact insulin as much. This in turn means you can reach ketosis, starting to work the fat on your organs (which is a lot more dangerous then some fat in fat tissues like your belly). Your body will recover, inflammation will go away and your insulin sensitivity goes up again (unless you are genetically diabetic). And with a healthy body your brain can also recover.

The studies for this are still coming in, but I find this explanation very logic and even this study, although the article is weirdly phrased, plays into it.

Some remarks at the end: - If you do a lot of sports, your muscles use energy even without insulin - Glucose is spread through the body, while fructose is directly converted to fat (tissue) - Sport also increases insulin sensitivity - Diets are very personal, try out things for yourself and see how it works! - Protein is also increasing insulin (since protein intake signals the body to start storing energy, i. e. protein into muscle cells)

For my understanding this is mostly attributed to insuline resistance vs sensitivity. As you get older and overexposed to sugar, your resistance raises and in order to reverse a lot of the internal inflammations your body has produced from over-intake of sugar you need to force ketosis and burn calories with a low-carb diet. This in turn helps reduce internal fat and repair organ functions, fundamentally restoring hormone production and refreshing your brain as well.

It does not mean that carbs in general are toxic, nor that this diet is recommended for everybody! Diets are very personal, it just becomes more and more common because sugar is added everywhere, people are getting older and older and obesity is a global problem. As such, most people are very insulin resistant and work better with low-carb/high-fat diets.

This headline is one of the reasons there is so much misinformation in food and diets

I mean they needed to wait for something big enough to bury it (Corona). Now's the perfect chance :kappa:

In all honesty though, there is a bunch of evidence in his US court case that basically frees him of all accusations in his british court case, but the judge refuses to accept it. Although the case is about delivering him to the US. So she denies the rightfulnes of the US court system, but wants to deliver a person to this very system???

And then there is a treaty of denying political extradictions. But then the judge said that she does not care for the treaty and only honors the UK Extraction Act, which does not mention any of it.

>Germany has/had extensive coal production (complete exit by 2038 IIRC) with lots of employment tied to it; of course that has subsidies.

I get that and I am glad it happened, it's just way too late for my liking. At least it's done, I can agree on that.

>That sounds more like a conspiracy theory. You don't stop stuff for being "too flexible" but because of other problem, e.g. offshore vs. onshore, transmission to the south, environmental concerns, wanting a different mix of renewables etc. .

You can't have energy produced disappear. So if you overproduce, it has to go somewhere and you need to stop production to not fry your energy grid. If you overproduce, and your coal energy can't shut down, so your network becomes more green/clean, the obvious choice is to shut down the flexible generator, i.e. wind energy.

>Yeah, so? Consumer electricity prices were never even mentioned in the "end-goal"?

That is true, but the EEG is making renewable energies more expensive for end-consumers. And I think that is the main point of this article.