donkeyboy

There is a paper on arxiv saying that GPT4 correlation with human evaluators on a variety of tasks with strongly positive. I am also uncomfortable with it, but using GPT4 as a grader is not as bad as you think.

I think this could be fake. He says it’s an MoE model, but then explains that it’s actually a blended ensemble. Anyone else have thoughts on that?

Actually, AIs have been training on AI-generated content for a long time now. An example of this is student-teacher distillation.

Being a top ranked Glassdoor company certainly helps in attracting talent. Their scores are a signal that help me determine which company to join/apply. Especially reading reviews of people in my/similar position.

Vast.ai is a cloud host similar to aws ec2 instances. Weights and biases is a cloud thing that you can track your model run (like how well is it doing so far, what is the current learning rate, etc). It shouldn’t be required - but I guess the training code was written assuming you have it

Very fun article. Convergent evolution is so cool. At the end, the author asked: why don’t plants also evolve into grasses?

Would like to hear if anyone knows. If you look at onion or garlic growing, it basically looks like a very long piece of grass.

Note: the tech market isn’t doing too hot, so don’t be too hard on yourself.

Applying to jobs can be a numbers game. Just keep applying.

Tune your CV to have keywords in each job application. Reach out to the recruiter on Linkedin and see if they can refer you. Have a trusted friend review your CV too.

Because it was developed by OpenAI, which is a company that wants to make money (for example through GPT-3 API calls). Historically, OpenAI has also been concerned that their SOTA models could be threatening to the world if released.

Yes, they exist, and they are called Linear Regression and Decision Tree. Not everything needs to be a neural network.

Anyway, residual connections in NNs as well as distillation being only a 1% hit to performance imply our models are way too big.

This was my exact reaction when I upgraded to ios16. I spent 20 mins looking how to get the page turn animation back. Sad

That sounds like the youtuber carykh.

They already have jit through numba.