Show HN: Update to my meta glasses API "Hey Meta send a message to ChatGPT" | Hacker News Reader

Show HN: Update to my meta glasses API "Hey Meta send a message to ChatGPT"

github.com

19 pointsdevon_c7 comments

v1.0.0: https://github.com/dcrebbin/meta-vision-api/releases/tag/1.0...

The previous implementation was very very hacky and used a bookmarklet alongside uglified messenger classes from 2 years ago to monitor a chat, it was also only for image messages.

The new release is a browser extension for chrome & firefox that you run on an alt facebook account on messenger that can monitor for new chat & image messages + video monitoring if in a call.

You can create a group chat and use a special method (instructions in the readme) to force the Glasses to be aware of the new group which allows for Hey Meta send a message/photo to _____ (ChatGPT, Perplexity or whatever you name the chat)

There are settings in the UI to change the AI chat provider, model and whether or not to generate and send audio via a text to speech provider (OpenAI, 11labs or Minimax)

I've also added video monitoring: you call the group chat and can have the extension to monitor the video output and send a photo to one of the providers every second (or a custom internal)

With the original project I did get an interview with the Reality Labs team but I ended up rescinding from the process for various reasons.

But, let me know what you think!

Planned features are listed under issues with the feature prefix: https://github.com/dcrebbin/meta-vision-api/issues

Open articleView on HN

This is fantastic! I've been wanting this, I'll try it very soon. If I'm understanding this correctly, it's an extension that monitors the FB account just to read the messages, right? Is there no API integration with FB messenger (or WhatsApp/Instagram/something easier than running a browser all the time)?

I did research into messenger bots quite awhile ago but stopped for some reason. It might of been that I couldn't trigger it with Hey Meta, but that's before I learnt how to force a friend/groupchat sync. (so might be different now)

It would definitely be better as it's quite a pain for daily use or out and about and more of a tech demo in its current state.

Hah, this is great. So many amazing use cases are being hidden behind walls.

I love my Meta Ray Bans but frankly Llama is not best in class and it also isn't plugged into the rest of my data, phone, etc. I know they won't, but I wish Facebook would let us choose which AI model we wanted.

Frustratingly they of course work as bluetooth input, so if you manually trigger a conversation with ChatGPT you can chat away with it via your Ray Bans of course.

I use ChatGPT voice mode all the time and when I did have my glasses (lost or stolen now) I called it all the time, reducing the friction for calling would be a great quality of life feature

I also have no idea they don't have location tracking like find my iPhone/airpods, seems trivial to add

Nice work!

The Meta Raybans are a fantastic device hobbled by a weak LLM and supported by a bad actor - Meta [1]. Frankly I feel dirty for running any Meta software on my phone. I can talk to ChatGPT or Claude using the glasses but unfortunately I can’t show them what I’m looking at which is what the OP has built.

[1] https://arstechnica.com/security/2025/06/meta-and-yandex-are...

I really wish Reality Labs would open up their API but with meta ai and llama I doubt that'll happen.

For open source glasses there's a few potential options, I think omi.me has an open smart glasses project.

I'm surprised no one has found a way to properly jailbreak them, it's a bit out of my wheelhouse but would be fun to try one day.

How do you talk to Claude? Maybe you meant Gemini?

P.S. I'm working on Android app to talk to any LLM ( iOS one is already out: Roxy Voice: https://apps.apple.com/app/apple-store/id6737482921?pt=12710... ) using an OpenAI-compatible completions endpoint.

Reply on news.ycombinator.com