sjkoelle

my loose understanding

1) transformers create an input x input size attention matrix that is unnecessarily large. state space models somehow compress this.

2) "The main difference is simply making several parameters [in the state space model] functions of the input"

3) i think it might be more sample efficient (requires less data)

disagree

Following - we host our own models for a variety of architectures in vocal synthesis, and have tried using Replicate and Mystic as well.

Roll your own k8s? Predibase?

is crispr a big improvement here over AAVs or zinc fingies?

When you do things right, people won't be sure you've done anything at all.

it changed my life

Thank you - also why target someone who has been there for only 2 years.

regulatory capture in action

sweet

awesome, good job

Generative model for cooking recipes. Input my ingredients, outputs a recipe.

Ooooh this is very cool. So much amazing AI for music right now like https://crfm.stanford.edu/2023/06/16/anticipatory-music-tran... - I wonder if it could be plugged in.

its insipid

Damn this wasn't the LoRa I was thinking of

mapsme had the conch in its hand

can some physicist explain why the calculations are so hard... something something Taylor series?

so youre saying we should leave it to beaver

ive written two projects with nbdev - its great, but after a while we moved off of it - too limiting

most bird related companies will not have issues with moats

i spent the last 8 years doing this... what could have been

huge if true

you havent seen skewered until you make a comment saying that bayesians and frequentists should bury the hatchet

the huascaran landslide too

its a real geologic zoo around there

if Terrence Williams is getting 10 years for defrauding the NBA curious what they will get

hmmmm maybe something like page 184 here https://apps.dtic.mil/sti/pdfs/ADA327435.pdf

REMEMBER THE MAINE!

There is a mathematical description of programming compilers I read once (think it was a survey paper) that I found very clear but I've never been able to find since. Basically defined a compiler as a type of function. Any good suggestions?

here is pmarcas take https://pmarca.substack.com/p/followup-to-why-ai-wont-cause-...