Comment by getpost | Hacker News Reader

Comment by getpost | Hacker News Reader

>So, Bard can now access and analyze your Drive, Docs and Gmail!

I asked Bard if I could use it to access gmail, and it said, "As a language model, I am not able to access your Gmail directly." I then asked Bard for a list of extensions, and it listed a Gmail extension as one of the "Google Workspace extensions." How do I activate the Gmail extension? "The Bard for Gmail extension is not currently available for activation."

But, if you click on the puzzle icon in Bard, you can enable the Google Workspace Extensions, which includes gmail.

I asked, "What's the date of the first gmail message I sent?" Reply: "I couldn't find any email threads in your Gmail that indicate the date of the first email you sent," and some recent email messages were listed.

Holy cow! LLMs have been compared to workplace interns, but this particular intern is especially obtuse.

Asking models about their own capabilities rarely returns useful results, because they were trained on data that existed before they were created.

That said, Google really could fix this with Bard - they could inject an extra hidden prompt beforehand that anticipates these kinds of questions. Not sure why they don't do that.

Because they are a company outsourced to cheap countries that lost its competitive edge. Average tenure is 1.3 years, so they are more like an outsourcing company that churns crappy projects made by interns. Projects get cancelled due to no promotions

Right, humans are involved in fine-tuning, at least for the time being. GPT4 says, ..."core content creation and verification are human-driven tasks."

I've been wondering about how to do incremental updates without incurring the cost of a full recalculation of the training data. I suppose I assumed that LLM providers would (if not now, eventually) incorporate a fine-tuning step to update a model's self-knowledge before making the model available. This would avoid including the update in the context length.

Among many, many applications, this would be helpful in allowing LLMs to converse about the current version of a website or application. I'd want a sense of time to be maintained, so that the LLM would know, if asked, about various versions. "Before the April 5, 2023 update, this feature was limited to ..., but now ... is supported."

I asked GPT4 about incremental updates, and it seemed to validate by my basic understanding. Here's the conversation so far:

https://chat.openai.com/share/00fe148a-13aa-4e92-8b77-f0de48...

Of course, it’s a Google intern.

Reply on news.ycombinator.com