chucky_z

Give nomad, docker swarm, or lxd a shot.

The GP did ask about logging though specifically. One of Docker daemon's more interesting features is how much log enrichment it does. Does kubelet do the same thing out of the box? I know containerd itself does not, unfortunately.

i 100% agree with you. open source feels really, really bad especially in the last year.

to others reading this -- simplified, but, docker uses containerd to build/run images. all docker images are valid containerd images. you can run images through containerd straight off the docker hub.

I do this today with Nomad/Consul. Hashicorp's Raft+Serf implementation allows for shocking amounts of latency between servers/clients. I have several centralized server clusters (the "servers" _should_ be geographically close, the "agents" can be far and wide), and agents more than 200ms+ away, and across multiple clouds/on-prem. Everything works just fine.

I've legitimately considered running some kind of simple SaaS and behind the scenes running a Nomad cluster and having the remote SaaS agent just be a Nomad client.

try out https://github.com/hashicorp/terraform-cdk i've had success with it thus far. i'm mostly using mainstream providers at this point though.

~445k in s3 costs according to aws calc, using a naive "there is 1 object in the bucket, it's been fetched 116 million times, and that used 580PB of fetch bandwidth."

I’m a bit confused here. Isn’t Pulumis big claim that it’s compatible with Terraform providers?? Why would Terraform trail that?

Check out Terraform CDK for a thing that is native to TF, allows real code, and is progressing real fast

I agree with you. As a counterpoint though, I worked somewhere that generated some of the heaviest and biggest reports of anywhere I’ve ever seen with a lot of concurrency and PHP handled the task fine. Node would have still been a better fit though :)

It’s like Java but you can actually use it.

It has no compile time, the development cycle is crazy fast, the stdlib is good for the web, every problem is solved so they’re all googleable, it has a good package manager now, great frameworks, good testing stuff, there’s a lot of positives atm

Have you ever tried Pypy? I know when I had issues with GC and some memory usage (specifically dealing with large datasets as well, I was parsing large MySQL query results -- many millions of rows) Pypy didn't really drop memory usage much, but it did give me an almost 10x speedup. Enough that I went "oh, guess I don't need to use a different language."

This is really cool!

I'm curious why CTEs don't seem to be getting used here?

  SELECT
  (
    SELECT
      (
        t.data,
        t.created_at
      )::jsonb_x_timestamp
    FROM
      telemetries t
    WHERE
      server_id = 'a0dcc312-0623-af60-4dc0-238301cc9bf8'
      AND data ? 'load_avg'
      AND t.created_at >= series.target
      AND t.created_at <= (series.target + INTERVAL '2592 seconds')
      LIMIT 1
  )
  FROM
  (
    SELECT
      target
    FROM
      GENERATE_SERIES(
        '2020-09-01 00:00:00'::timestamp,
        '2020-09-15 23:59:59'::timestamp,
        INTERVAL '2592 seconds'
      ) target
  ) series

I'm curious on the performance of:

  WITH series AS SELECT
    target
  FROM
  GENERATE_SERIES(
    '2020-09-01 00:00:00'::timestamp,
    '2020-09-15 23:59:59'::timestamp,
    INTERVAL '2592 seconds'
  ) target
  SELECT
  (
    t.data,
    t.created_at
  )::jsonb_x_timestamp
  FROM
    telemetries t
  WHERE
    server_id = 'a0dcc312-0623-af60-4dc0-238301cc9bf8'
    AND data ? 'load_avg'
    AND t.created_at >= series.target
    AND t.created_at <= (series.target + INTERVAL '2592 seconds')
  LIMIT 1

or even shuffling some of the other selects and chaining CTEs together. I'm even curious if you could somehow use a combination of CTEs to generate something more suitable for use with SYSTEM_ROWS (TIL!! will keep this in my pocket for the future!).

CTEs are never a guarantee for performance improvements (they make things worse at times) but I see them getting ignored a lot when at times they are a huge boost.

Edit: wow the formatting is really bad, hopefully the code stuff doesn't kill it for mobile users

The way I've used external extensions in the past is by using a weird setup with non read-only replicas off the RDS primaries running in an EC2.

It "works," but... operator beware.

I'm also not exactly sure if you'll get full stats out of a replica.

So I actually do this today, and I use Vault. This sounds weird, but I spin up a "bootstrap PKI" Vault that is local-only, and produces, e.g.: "consul.service.dc.consul" certs with the issuer labeled as "bootstrap PKI intermediate" or some such. I generate a full suite of these for everything in a space, get it all up and running, then there's a 2nd layer of automation where self-certs are issued.

That said, I'm moving to a central distributed Vault that is mostly going to exist as a PKI so I'll only really need to repeat this process once more! Going to be using the raft internal engine for this one, and spread it physically across the globe so performance is going to be pretty terrible by design, but it should be quite resilient!

Didn’t Teams just have a massive outage too?

Weird. I tell my folks to get their work done and I expect them to schedule their own time because I trust them as professionals. If they need to work between 6pm to 2am or 4am to 10am because that's when they're the most productive, or they're dealing with something in life and they're still getting the work done I trust them. I feel folks get fully jaded because everyone sets up all this rigidity and there's a huge lost of mutual trust and respect because of it.

Coming in twice an hour late and being ridiculed about it is ridiculous. This is professional life, not some strict grade school.

I'll be a single counter-point. I straight up reinstalled Windows to play Valorant and all it's done is made me play a lot more CSGO. I'm legitimately having more fun with CSGO now than I have in a very long time! The game feels like it's in a super good place. It's got a ton of cool skins, the competitive scene feels really competitive at the moment, playing it competitively feels great. The DM mode scratches a very good itch, gun game is still a lot of fun, etc...

A close friend of mine got married 3 years ago. He is a dual citizen of China and the USA. His spouse is a Chinese citizen.

This straight path you speak of they have been filing paperwork for and fighting for, for 3 years now. I believe he is just in the path to permanently moving to China and revoking his US citizenship status.

Everything about this process sucks. :(

Usually $0.

I've been in this situation. Getting a $1000 budget approval took months and was _tough_.

Skip AWX entirely and just use Jenkins. As insane as this sounds, I've personally done Jenkins => AWX => Jenkins twice. A good shared library can entirely replace AWX and the level of authn/authz plugins with Jenkins blows away any granularity with AWX.

InSpec is really a good tool you should know. I believe you can write molecule tests with it so it’s something you may have already used at this point and not realized it.

Does anyone from Progress or Chef know how this will impact anything?

On that note, does anyone from Cinc know if this will have any impact on that project?

I’ve been speaking to a friend who works at one of these companies and they had no idea this was happening.

Before going any further, take a _really close look_ at https://docs.aws.amazon.com/elasticsearch-service/latest/dev...

Make darn well sure you aren't using any unsupported operations.

In their favor, if I were to revisit them I could use it now; however in the past they didn't support templates and a few other things which turned out to be major blockers.

what about those pinatas? are those still in the game? that's very much a loot box if so.

I wrote a daily utilized utility (probably still in use) that made good use of PyPy, it was pretty slow and after quick profiling I found that type check functions (PyMySQL) were being called A LOT of times. Literally changing the runtime from python3 to pypy was something like an 8x overall speedup.

I went from an Influx getting crushed to VM running in a container with 1/8th the resources and it works fine, 1.5m active cardinality. Could handle a lot more probably. Auto fill in Grafana breaks but oh well!

it's us-west-1! :D

we've had a ton of instances fail at once because they had some kind of rack-level failure and a bunch of our EC2s ended up in the same rack. :(

I think if you use open source stuff you will find a lot of Avro, like Debezium. Supporting both so you get best of in-house and external makes sense to me.

On that note, the grpc spec specifically calls for load balancing that doesn't actually do the proxying, but instead hands out assignments, with the server passing it's current load back to the load balancer service. it sounds like in this case the grpc client is using some array of xDS, but the server is using xDS along with...?

The operational overhead shifts to more API stuff, so people can write 100 lines of code instead of modifying 1 line of config, it feels like.

This is never going to end as more things shift towards being core APIs that allow you to write code instead of configure things. It's not even configuration-as-code, it's just code managing configuration files.

edit: I think my comment comes across maybe kinda rude. My beef with Envoy is that the documentation is _extremely_ complex, and I've repeatedly asked 'How do I get started with xDS?' and been pointed to the spec, which I think took some time to read through and when I asked others about how to setup LDS/RDS/CDS/SDS was met with a like 'what are these things...? just use xDS,' which led me to a lot of frustration. This has been my experience each time trying to approach Envoy, and xDS.