983 karma · joined May 13, 2007
* Groq can't produce more hardware past their "demo". It seems like they haven't grown capacity in the years since they announced, and they switched to a complete SaaS model and don't even sell hardware anymore.
* I dont know enough about MLX, Triton, and JAX,
https://blog.jtoy.net/examining-concepts-through-different-f...
https://blog.jtoy.net/on-the-wondrous-human-simulation-engin...
https://arxiv.org/abs/2210.12068
The human brain has at least over 12 different coordinate systems. I like to reference this image: https://cln.sh/gpqhwrw2Hg92MQz62TY6
Humans have the ability to inspect anything from any point of view that we want, like a real time video game simulation system in our minds. I suspect that artificial neural networks are missing this core ability to encode and translate its point of view when processing data. Just look at basic LLMs failing at the reversal curse: https://arxiv.org/abs/2309.12288 No amount of more GPUs and more training data will fix it.
The entorhinal cortex in humans has a special kind of neuron called grid cells that works with hippocampus cells to do generalized coordinate translations. The discovery of grid cells won a nobel peace prize ( https://www.nobelprize.org/prizes/medicine/2014/advanced-inf... ). It is a prime suspect to incorporate for a coordinate transformation layer in my opinion.
I want to build an ANN that incorporates this "coordinate transformation system", but I'm not sure how to translate it into code, this is my dream project.
* can you make it so we can share links of sessions?
* can you describe on the homepage or in a link from the homepage what it does.
#python code
import ffi_like_interface as ffi_like
jquery = ffi_like.transpile_js_library('jquery') json = jquery.call("function(args)") use_in_python(json)