ckrapu

A thought I often have - older millennials and younger Gen X have a unique obligation to fix certain parts of society because we are the youngest generation old enough to remember how to operate in and enjoy a world that wasn't A/B tested into a gray, lifeless background hum.

From this perspective, humans are just ECC with an optimally non-zero bit flip rate for evolution.

I think Theano takes the crown as first modern end-user library for autodiff and tensor operations.

Mobile experience is not great

I agree with some of the author’s criticisms, but diversity citations are a minor concern compared to the idea of paid access to publicly funded research.

I want to help teach basic application design for GenAI. I've got a basic repo setup, but it's largely based on my own developer experience.

Any feedback is super appreciated.

I'm aiming it at new college grads who haven't had to maintain several services at once in production.

Do you think the basic physics and sensor tolerances would let you go to 10^-2 meters if the environment (e.g. wifi station placements, location of RF-interfering elements) was designed by you?

The title is true if there is no meaningful selection or attrition process for your degree. Otherwise, I disagree strongly.

I think that one’s opinion of this article’s premise is really an index into what your program was like.

Nice idea. The AI infra trend was pretty bad, though. Where are coreweave, nebius, supermicro and others like them? The selection of companies seems like it came from an LLM without any knowledge of the last two years.

I love the idea but when I tried to reduce "SCARFS" to "CAR" (the right answer) it rejected my choice of S, but let me select the other letters. Looks like a bug. Clean it up and I would love to play more!

This happened to me when I decommissioned an App Service instance on Azure.

I totally forgot that it has a readable (I.e. guessable domain name) because AWS’ equivalent service doesn’t. I also had a company subdomain pointing to it so someone got to put up a malicious page on our domain for a day :(

I do know my writing style has problems. My writing teacher said my style was pretentious, and I try to tone it down.

I sort of take this as a compliment, because I've been writing like this my whole life and if it reads like LLM slop, then there's the implication that the result of all of OpenAI's A/B testing and post-training leads to something like my style which at least means it gets people to engage with it!

My colleagues definitely thought it was a joke at the time.

We had this project (all public research) to classify buildings and identify their different subsystems (e.g. load-bearing structure, roof type, ventilation type) to figure out the expected casualties if there was a WMD event of some type. We could get decent data for much of the world, but for some places we had literally nothing beyond a tiny picture of it from satellite imagery.

I had been playing with using GPT-3 to try to have it autocomplete forms like the following. This was 2021 before we had good APIs for instruct models, so this was just straight up letting the LLM regurgitate after pretraining. Here was the type of prompt we used:

""" Engineering building report for building located at 123, X Street, Knoxville TN Prepared by Benjamin Lee, FE --- Building footprint area: 1200 m2 Roof type: built-up roofing Facade material: brick HVAC present: """

Surprisingly (at the time), this was a decent prior. You could also add all sorts of one-off points of interest and amenities like swimming pools and other trivia to help guide the conditional probabilities.

I did make a comment to that effect at the end

Do it, but just don’t pass it forward blindly!

To be honest, as the author, I am pretty insecure. That sounds like an accurate reading.

Admittedly cringe, and changed!

What is going on here? Is there some sort of game being played with the CPT system?

Very cool.

Reads like it was written by ChatGPT.

By this logic, I lost $500B by not getting options on NVIDIA and timing every single successful jump.

Looks like it was mostly LLM generated

Makes perfect sense. Looking forward to trying this.

You're conflating culture war issues with ideology.

For most of the world, left and right are economic axes despite the American corporate media's attempts to convince you that the 0.1% of crossdressers are more important than making sure you and your family get a fair wage and clean air.

"It’s well-known that all leading LLMs have had issues with bias—specifically, they historically have leaned left when it comes to debated political and social topics. This is due to the types of training data available on the internet."

Perhaps. Or, maybe, "leaning left" by the standards of Zuck et al. is more in alignment with the global population. It's a simpler explanation.

He lives in the utopia protected by the public army and opines via the network invented by public research.

I love H3. Isaac and Uber did a real service to the geospatial community with that one.

Awesome stuff. I've read some of the probabilistic ML work from you guys and am stoked to see a competitive alternative to autoregressive decoders. Best of luck!

That’s an interesting counter example. I agree to an extent, but I also point out that only in semiconductor work is it normal to have factory shifts of technicians who have PhDs.

I've seen the Kalman filter presented from a few different angles and the one that made the most sense to me was the one from a Bayesian methods class that speaks only in terms of marginal and conditional Gaussian distributions and discards a long of the control theory terminology.

This was one of the books we used: https://link.springer.com/chapter/10.1007/978-1-4757-9365-9_...