HNHacker News
TopNewBestAskShowJobs

mrfox321

396 karma · joined July 26, 2019

submissionscomments
mrfox321··on Coding Addiction: How Programming Affects Your Brain
Yup I've had recursive dreams. You're likely internalizing something you're grokking
mrfox321··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
I'm not saying it's 50/50.

But future signees are influenced by previous signees.

Acting in good faith is different from bias.

mrfox321··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
The key is that the support is not anonymous.
mrfox321··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
Doing the math, it is extremely unlikely for a lot of coin flips to skew from the weight of the coin.

To that end, observing unanimous behavior may imply some bias.

Here, it could be people fearing being a part of the minority. The minority are trivially identifiable, since the majority signed their names on a document.

I agree in your stance that a majority of the workforce disagreed with the way things were handled, but that proportion is likely a subset of the proportion who signed their names on the document, for the reasons stated above.

mrfox321··on We have reached an agreement in principle for Sam to return to OpenAI as CEO
What would you do if 999 employees openly signed a letter and you are the remaining holdout.
mrfox321··on Toyota’s advanced battery technology roadmap
Lexus is Toyota. In Japan, they are branded as Toyota, hood symbol and all. They just market them differently in the West.

The same thing goes for the Acura / Honda distinction.

mrfox321··on RAG at scale: Synchronizing and ingesting billions of text embeddings
Your intuition on search being implemented is correct.

It's still TBD on whether these new generations of language models will democratize search on bespoke corpuses.

There's going to be a lot of arbitrary alchemy and tribal knowledge...

mrfox321··on PID Control Challenges
It can be stated as follows:

The number of documents (denoted as N) to search over consumes resources and increases the overall latency of the search infrastructure. However, the amount of traffic ebbs and flows. Under periods of lower traffic, we likely can increase N to provide good search results without violating latency constraints. Conversely, high traffic periods likely requires lower values of N.

Let's then approximate system strain by p99 (or p99.XXX) latency.

Solution:

Use a PID controller to set N as a function of latency (p99, p99.5, etc.) of the cluster. This leads to the outcome where N reduces when p99 latency starts to spike (resource starvation), and increases when p99 is low.

mrfox321··on Do not put plastic in the microwave
You don't want faster solutions? Even when you really need to value your time?
mrfox321··on Graph Neural Networks use graphs when they shouldn't
When you say hashed bags of sub graphs, are you generalizing bag of words, here?
mrfox321··on Maybe Rust isn’t a good tool for massively concurrent, userspace software
If your system cannot be decomposed away from shared mutable state, then you cannot avoid lifetime management and synchronization primitives.

Ultimately, it depends on your data model.

mrfox321··on How Query Engines Work
because they are assuming the reader has already built a query engine and is now re-writing it.

first prototype: bottom-up design

second pass: top-down design

mrfox321··on How Mojo gets a speedup over Python – Part 2
That sounds intractable.

How would you differentiate mojo code from vanilla python without a ton of boilerplate at language boundaries.

mrfox321··on Amazon CEO reportedly told remote employees: It’s probably not going to work out
The same group think happened during COVID.

Tech closed up shop on a Wednesday. Finance shut down the following Monday.

mrfox321··on Earning the privilege to work on unoriginal problems
I think you overestimate the likelihood of being judged on code in GitHub.
mrfox321··on Kullback–Leibler divergence
Typo in cross entropy, should be

p log q

mrfox321··on The matrix calculus you need for deep learning (2018)
Yeah matrices are more abstract. I guess I am just pointing out that your concrete example of non-commutative rings (matrices of matrices) still needs a proof to demonstrate bijection between 4N x 4N (scalar) and 4 x 4 (N x N(scalar)).

Block MM demonstrates the equivalence.

mrfox321··on The matrix calculus you need for deep learning (2018)
Re [1]: it's fairly concrete to simply say that matrix multiplication can be performed block-wise.
mrfox321··on Which vector database should I use? A comparison cheatsheet
Are you aware that the gzip paper fudged their accuracy numbers by assuming an oracle could correctly pick from the nearest 2 neighbors with 100% accuracy?

In other words, they published top-1 accuracy from top-2 accuracy calculations.

I would not over-index on that paper. However, I would err in favor of simpler methods.

mrfox321··on Attention Is Off By One
You are misreading things.

Regardless of numerical stability tricks (e.g. exp(x_i-max(x))), you are still simply normalizing the logits such that the probabilities sum to 1.

The blog adds an additional hidden logit (equal to 0) to allow for softmax(x) = 0 when x -> -inf.

mrfox321··on Hollywood movie aside, just how good a physicist was Oppenheimer?
Einstein expanded several fields of physics.

Special + general relativity

Microscopic definition of Brownian motion

Photoelectric effect

Mass-energy equivalence

mrfox321··on JDF.jl – Julia DataFrames serialization format
Sure it does.

Have you seen the type system used to generically dispatch matrices to GPUs or cpus.

Or the dispatching to give you auto-differentiation?

Maybe it's not your definition of "new ideas", but they are really useful and original.

mrfox321··on How to think about async/await in Rust
Right, so it's less efficient than async.

Async would let you yield at the gather.

mrfox321··on Threads, an Instagram app
Because "Instagram is cool"

Joking aside, this is a branding decision.

mrfox321··on Are You Sure You Want to Use MMAP in Your Database Management System? (2022)
Isn't that the opposite? That is, bypassing user space, not kernel space?
mrfox321··on Inflation is as corrosive to investing as it is to the real economy
Deflation can be self-reinforcing, too.

If both directions can lead to runaway feedback, it likely needs to be controlled.

mrfox321··on One thousand balls dropped on a double well curve (~ x^4 – x^2) [video]
I'm not in the field, but some of your questions are research problems regarding boundary conditions of the laplacian operator.

There's also similar work framed in terms of billiards:

https://en.m.wikipedia.org/wiki/Dynamical_billiards

mrfox321··on Dynamic programming in Haskell: automatic memoization
same with python:

@functools.cache

def fn(x):

https://docs.python.org/3/library/functools.html#functools.c...

mrfox321··on Infinite tiling pattern could end a 60-year mathematical quest
Yes, that's the definition of aperiodic tiling.

There is no translational symmetry.

mrfox321··on Dose-response relationships of LSD-induced subjective experiences in humans
It does not plateau at 100mcg...
← PreviousPage 2 of 7Next →