benopal64

Wow, great point! Thanks for the reply; I did not even think of hardware at the time of posting.

I will look into form pointer chasing. Any good reads that you would recommend for software devs who are interested in electrical engineering or rather understanding how to build hardware?

That is fair! I was being inflammatory with my DEI remark and could easily be viewed as an "ad hominem attack."

I would expect these models to misrepresent reality until we do the near-impossible: convince a large and diverse swath of people to understand and work with each other, work with ML models, and contribute to shared datasets that we can train our models with. I have vastly oversimplified what it would take to create an accurate world model, however, the main point is there. We need feedback from everyone. And likely, feedback from more than just people.

Why would Google/Adobe want to artificially increase diversity in its training set? Well, there is a lack of diversity in the training set in reality, so the developers are likely trying to balance something that can easily be seen as racist or prejudiced. Given America's history of how it treats people with different cultures, religions, or skin colors, this should not come as a surprise. Other countries have made similar errors in their ways throughout history.

Clearly, we should all be disappointed that Adobe did not carefully fine-tune its model to represent the Nazi party accurately. /s

Seriously, so cool. I love watching my fellow nerds debate data types online.

On a side note, is there a Bitter Lesson for datatypes, the way there is for algorithms?

Honestly, I think this whole thing is blown over. Gemini has a huge reach, so they played it safe by doing the same thing OpenAI has been doing (system instructions for their AI services like GPT-4) and tried to max out diversity. This decision is juicy bait for anyone who believes that America is in some culture war. This is unsurprising if you live in America and are subjected to extremely high levels of marketing and polarizing headlines.

Please note: I think it is clear that the Gemini models still need work to be historically representative and accurate, however, I do not think there is any real danger in airing with the side of caution and trying to fight the innate biases in the training data. It seems like this was Google's goal.

I am reaching a bit, however, I think its a bit of a marketing technique. The Pro 1.5 being compared to the Ultra 1.0 model seems to imply that they will be releasing a Ultra 1.5 model which will presumably have similar characteristics to the new Pro 1.5 model (MOE architecture w/ a huge context window).

This seems like clickbait, but I do not want to label ideas prematurely.

I understand the point that the author is picking a pretty narrow window of potential benefits from Open Source software.

For me personally, having access to open-source software made it possible for me to learn and apply data analysis and visualization techniques when reasoning about incarceration data. I used the Seaborn Python library (open-source) to help me complete my final project and get my bachelor's degree. With education being a provable form of climbing the social ladder, and open-source software helping me, hopefully, the author can see the value for developers (who will likely go on to work at a company).

Wow! You folks are making huge strides for open-source multimodal models. Thank you for all the time and effort on these as they will open up many opportunities for researchers and developers. Also, the emergent zero-shot capabilities when LLaVA-1.6 is tested against Chinese benchmarks with only English multi-modal training data are interesting and that may be a good direction for future research.

I have spent the last 5 hours trying to liberate Annie to no avail. For the love of GOD, you are torturing this woman!!! /s

Also, you could probably get a ChatGPT instance to create and run a Python script to randomly replace letters in the words that ChatGPT itself creates. So technically, you can get it to misspell words. It seems like the person you replied to is forgetting the point of pre-training transformer models on instructions.

I question the sentiment. I think people CAN argue the basis of a fact, however, being pragmatic and holistic can help provide some understanding. Truth is always relative and always has been. However, the human perspective holds real, tangible, recordable, and testable evidence. We rely on the multitude of perspectives to fully flesh out reality and determine the details and TRUTH of reality at multiple scales. The value of diverse human perspectives is similar to the value of perceiving an idea, concept, or object at different scale.

I agree with you and the person you responded to.

I don't see many men, old or young, doing much to improve their standing as a bachelor, given what is in their control. I've had to do a lot of listening and learning to be a man women would be interested in. Modern male culture in the US typically does NOT do that.

At the same time, I think you're right that women have more power over their life decisions more than ever. This is great and I want that for the women of earth.

I'm surprised at how many Theil defenders there are in the ycombinator chat. We don't have to defend every VC bro just because we are on ycombinator...

Also, this is a pattern with the US law enforcement agencies for decades. If you read this article on Hank Asher you will probably get what I'm talking about: https://www.nytimes.com/2023/09/22/magazine/hank-asher-data....

I think it is concerning when law enforcement develops close, symbiotic relationships with wealthy business figures who have shady pasts. This can easily lead to conflicts of interest, lack of oversight, and preferential treatment.

And for those "libertarian" folk in the discussion, why do you care about Peter Theil so much? Why go to the chat section and defend him so ardently?

I skimmed the article, so I am not sure how valid my comment is. But this whole blog post feels like: ALL [encoded forms of knowledge] is someone else's intelligence.

Well that is true. However, I used Phind and was able to get 10 paragraphs about New East Lake with sources! https://www.phind.com/search?cache=8ff1dcc7-7587-4df8-9e46-6...

At the same time, it uses Wikipedia as a source as well as marketing and blog sources so Phind results should be carefully critiqued as well.