3,829 karma · joined September 15, 2019
Socials: - calendar.app.google/YhrgwoqZu3MdsaBs6 - github.com/ofou - linkedin.com/in/ofou - x.com/omarnomad Interests: AI/ML, Data Science, Digital Nomad, Education, Entrepreneurship, Open Source, Research, Science, Startups, Technology, Books, Climate Tech, Networking ---
https://www.google.com/maps/contrib/107193335994695458225/ph...
https://docs.google.com/spreadsheets/d/12cza6j1QuSMbc5cOf3pB...
Layers: 24
Hidden Size: 1024
Attention Heads: 16
Using the formulas:
Neurons = Hidden Size * Attention Heads * Layers
Parameters = Attention Heads * (Hidden Size^2 / Attention Heads) * Layers
Plugging in the values:
Neurons = 1024 * 16 * 24 = 393,216
Parameters = 16 * (1024^2 / 16) * 24 = 345,471,744
Therefore, for the GPT-2 Medium model, the number of neurons is 393,216, and the number of parameters is 345,471,744.
Parameters = A * (H^2 / A) * L
Is that OK?
"Finally, our work raises ethical and legal questions, including whether the open-source community should continue to advance progress by “stealing” what OpenAI and other companies have done, as well as what legal countermeasures companies can take to protect and license intellectual property."
Really???
Remote: No preference
Willing to relocate: YES (SF or Austin)
Technologies: Fullstack Python / Typescript + React.js, Linux, Mongo, AWS, Gcloud
Résumé/CV: https://www.linkedin.com/in/ofou/
Email: omar @ nomad.top
"In vitro neurons learn and exhibit sentience when embodied in a simulated game-world".
https://www.sciencedirect.com/science/article/pii/S089662732...
brew tap homebrew/cask-fonts
brew install --cask font-fira-code