Show HN: Perplexity (llama3 70B) Inline Bot on Telegram | Hacker News Reader

Show HN: Perplexity (llama3 70B) Inline Bot on Telegram

telegrambots.ai

13 pointssandoche12 comments

Word of caution when using perplexity to summarize URLs. I have tried the API and had lots of hallucinations.

It worked better in the UI, I only had it with the API.

Yeah, I don’t know why their API is inferior to the UI. Pretty disappointing. I’ve had better luck with my own “clone” that makes a web search and summarizes the results into an answer.

I've been evaluating OpenAI (GPT-3.5 and -4o) for a project at my company and I have seen differences in quality between the api and the web version as well. Same prompts. The api version seems to vary a lot more in quality.

Play around with temperature. Summarization is quite a defined task, so lower the temp a lot.

It's not just that. Following instructions, text generation, etc. all seem to be worse with the api version. At least, when it comes to 3.5 - 4o is much better. Ironically, 4o had problems with correct json output where 3.5 hadn't. It produced ```json {...}``` instead of just the json object.

very bad compare to perplexity https://www.perplexity.ai/

I asked the time and it is 6 days late: I wrote about the delay and it says I may be pregnant

please note that this is not a free service

but, most of all, who wrote the bot? who will read what you write there? where is the privacy page? the EU privacy regulation ecc ecc?

the web page is not Telegram owned, and the https://www.telegrambots.ai/privacy-policy I read there does not formal enough to me.... plus,... how can they offer you to add your bot, and at the same time have that privacy policy ? they control the code of my bot ? that "verified" sounds not formal too..

if it is an experiment fine... but it does not looks like it is

Is this Perplexity the search engine? Why does it mention Llama in the title?

I'm guessing because perplexity is now based on llama 3. If you look at their labs [1] the choices of models seems to suggest this.

[1] https://labs.perplexity.ai

Sure, but it's a bit too "under the hood" to mention in something like this, no?

I like under the hood info, that is why I am in hackernews :)

What if perplexity decides to switch to another LLM backbone in the future?

The money is in the app layer and compute. There's no reason to train foundation models to compete with Anthropic, OpenAI, Meta ect ect. Its the equivalent of lighting money on fire.

Reply on news.ycombinator.com