HNHacker News
TopNewBestAskShowJobs

ralfelfving

257 karma · joined March 25, 2023

Learning how to build things. 11 years of data and product at Klarna, Shopify and Gadget.dev
submissionscomments
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thanks, glad you liked it!
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Hmmm... what if I added functionality that uses the webcam to read your lips?

Just kidding. Text seem to be the most requested addition, and it wasn't on my own list :) Will see if I add it, should be fairly easy to make it configurable and render a text input window with a button instead of triggering the microphone.

Won't make any promises, but might do it.

ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Glad you liked it!
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thanks! You could probably grab what I have, and tweak it a bit. Try checking if you can screenshot just the error message and check what the value of the window.owner is. It should be the name of the application, so you could just append `Can you help me with this error I get in ${window.owner}?` to the Vision API call.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
No, this is an oversight by me. To be completely honest, up until the other day I thought it was still called OSX. So the project was literally called cOSXpilot, but at some point I double checked and realize it's been called macOS for many years. Updated the project, but apparently not the code :)

I suspect OSX vs macOS has marginal impact on the outcome :)

ralfelfving··on Show HN: Find the best flight redemptions using crowdsourced data
Oh nice, could be helpful if this takes off with the data!
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thank you for checking it out! <3
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
It can be replaced with a self-hosted LLM, simply change the code where the Vision API is being called. That's true for all of the API calls in the app.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
I assume that anyone capable of cloning the app, starting the it on their machine and obtaining + adding an OpenAI API key understands that some data is being sent offsite -- and will be aware of their corporate policies. I think that's a fair assumption.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
There's definitely some improvements to shuttling the data between interface<->API, all that was done in a few hours on day 1 and there's a few things I decided to fix later.

I prefer speaking over typing, and I sit alone, so probably won't add a text input anytime soon. But I'll hit you up on Discord in a bit and share notes.

ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thank you for the explanation! At the end of the day, I'm a newbie and I'm in it to learn something new with each project. Next time I'll probably try my hand at a different framework.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thank you! I got pretty thick skin, but always a bit of insecurity involved in doing something the first time -- first public GH repo and Show HN :D
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Time to learn learn Swift in the next project then! Thank you for the deets.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
I appreciate the comment, I really do! Fwiw I play around with thumbnails and titles quite a bit to try to learn what seem to work, and I think the underlying sentiment in the comment rings true for most in my audience. Aaand, it may be a coincidence but the views just hockey-sticked when I changed it :D
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Thank you, it's my first GH project & Show HN.. and.. yeah.. learning here :D
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
I like hotdogs :)
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
I don't know man. I'm new to development, it's what I chose, probably don't know any better. Tell me what you would have chosen instead?
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
There, changed it.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
We can, if someone builds it. :)

I'm new to development, and this is what I went with. Don't know any better.

ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Apparently we aren't, so I changed it :D
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
Nice!
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
That's ok, I'm with you -- it's more of a joke with friends that developed after I started making tutorials. I primarily use a normal face expressions, and they said I should use one with open mouth -- so I did for funsies, and been doing it a few times over the months although I feel it's a bit cringe.
ralfelfving··on Show HN: Open-source macOS AI copilot using vision and voice
There's one at 00:30 in this YouTube video (timestamped the link): https://www.youtube.com/watch?v=1IdCWqTZLyA&t=32s
← PreviousPage 2 of 2