So, why would this extract more semantic meaning than multi-head attention? Isn't the whole point of multiple heads similar to how CNNs use multiple types of filters to extract different semantic relationships?
383 karma · joined May 22, 2010
Wow, that's incredibly reductive. Asia has approx 4.7 billion people!
I moved to the US (Bay Area) about 10 years ago after having spent much of my youth elsewhere, and to this day, I haven't been able adjust to the lack of informal social interactions compared to where I'm from. I really tried as well to see if it's me who is not able to fit in. However, after a while I realized it's just a cultural difference. It's a way of life that has existed for several decades, which has its own benefits.
To me, US seems like an amazing place when you're in the apprentice/work phase of your life (20 - 45?). However, as I grow older, there are other things I have begun to value more, and one of the top ones is authentic human connection. I hope as US becomes more and more diverse, people from other cultures can add the good things they bring, instead of just trying to fit in to the default cultural model.
However, I still believe it can be fixed. As an example, my consumption of news related information has moved significantly to Twitter. Why not do a better job there, in trying to provide a kick-ass way for content creators/consumers, and charge them for it.
Observe your emotions - there may be a completely different solution to your problems.
You could for example pick something as simple as a HashTable, and implement it from scratch. Then, you could add more complexity to it, like HTs that won't fit in memory, expanding and shrinking HTs efficiently etc.
Or, you could use one of the several practice websites like LeetCode to practice Algorithms/DS problems.
Once you start building a habit, you will also become better at organizing your practice routine and finding out more about what to work on, and where to look for study/practice materials. But mind you, this is a slow process, which you want to build as a habit. There is no end goal here (like cracking Google interview or such), this is a process to get better at the fundamental skills in your field.
1. Not being afraid to look at the code of the libraries that my main project depends on. It's a slow, deliberate process to develop this habit and skill. But more importantly, as you keep doing this, you will develop your own tactics of understanding a library's code and design, in a short amount of time.
2. Not worrying about deadlines all the time. Not a programming technique as such, but in a world of standups and agile, sometimes, you tend to work for the standup status. Avoiding that has been a big win.
3. (Something new I've been trying) Practicing fundamentals. I know the popular opinion is to find a project that you can learn a lot from, but that may not always happen. Good athletes work on their fundamentals all the time - Steph Curry shoots like > 100 3 point shots everyday. I'm trying to use that as an inspiration to find some time every week to work on fundamentals.
4. Writing: essays, notes. In general, I've noticed I gain more clarity and confidence when I spend some time writing about a subject. Over time, I've noticed, I've become more efficient in the process.
I know I'll get downvoted, but I am genuinely amazed by how a small minority of people can gain so much control, and absolutely no one complains. I know there are historical reasons, but it is fascinating nevertheless.
All the best!
Specifically, on "... executive level bullshit politics related to their short term compensation milestones ...", I would like to add, this one is the hardest to figure out and has a significant impact on your growth not just within the company, but as a person in general.
Any more suggestions, on good ways to find out if this is part of the company culture?
I've been trying to find solutions myself - I'm trying to use some strategies listed in this book: The inner game of tennis, by Timothy Galloway, and I'm seeing positive results so far. He talks about 2 versions of self: self1 - the doer and self2 - the judgemental self, which is constantly evaluating self1, and adversely affect self1's potential. He has some useful suggestions on how to limit the impact of self2, and I found those pretty helpful so far.
I really like(d) Twitter. I feel it has played a huge role in democratizing public opinion, so that I don't just create my opinion based on what media houses throw at me. For me, it narrowed the gap between so called "celebrities" and normal people. It made possible for me to interact with and get insights from people whose work I care about.
I feel so bad about the poor execution on their product side. They get free marketing - they are all over the tv, news websites etc. So many popular people use Twitter to share information. What more can they ask for?
There are so many things that Twitter could've done first just because it was in a position to like no-one else:
1. Media sharing: absolutely ridiculous experience to the point that people share images/video on some other platform and end up posting the links in tweets. Even then, for an consuming user, the browsing experience is shit. WTF twitter?
2. Content sharing: twitter as a platform has way more relevant content (URI's, first person messages etc) than any other news/media platform. What do they do with it? They do nothing. Twitter can learn so much about my interests from so many signals that I (used to!) give them - they do nothing to help me read content that interests me.
3. Live: there is no better place than twitter to potentially learn about what's happening right now. How do they facilitate live content sharing? By having a completely different app for video (periscope) which creates a fragmented user experience.
4. Fun: they had vine - they kept it as a separate app (again creating fragmentation) and eventually killed it. How are you going to attract young users if you don't keep on trying new, fun, cool stuff?
5. Spam: for all the attention that fake news is getting right now, Twitter has been in a unique position to innovate in this area. Unfortunately, afaik, it has done nothing.
</rant>
And then I feel sad, because all the effort to seek that personal connect with work at my current workplace, have been taken away by a disconnected and immature middle management, which only works for meeting the goals and deadlines given to them...