Hacker News Reader

iliashadon Orcah Studio: A local-first video agent that can search your videos

I added the lower battery mode. haha.

Noted. Would like to show the app in a 15-minute call here (https://cal.com/iliashadad/orcah-studio-demo)

Yes, the Docker container is pretty different than the app, but it does share similar infrastructure with richer video scene data, direct integrations with Davinci Resolve, Final Cut Pro, and Adobe Premiere Pro, and a smart video search agent.

Thank you for your comment, much appreciate it

iliashadon Orcah Studio: A local-first video agent that can search your videos

Plus, you can search your video moments using a reference image or color https://orcah.app/features/visual-search or an audio file https://orcah.app/features/audio-search.

And transcription with speaker diarization: https://orcah.app/features/transcription

iliashadon Orcah Studio: A local-first video agent that can search your videos

Plus, I have a source-available version that can be self-hosted via Docker (https://github.com/iliashad/edit-mind) (Rebranded from Edit Mind to Orcah Studio)

iliashadon Show HN: Local-first video intelligence for Mac – find by text, visual, or audio

You can read more about the story of this project: https://orcah.app/about

iliashadon Show HN: I indexed 37h of my videos using an RTX 4090 and local ML models in 24h

Link: https://iliashaddad.com/blog/i-indexed-37h-of-my-youtube-lib...

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

I made part two of this, but this time using RTX 4090: https://iliashaddad.com/blog/i-indexed-37h-of-my-youtube-lib...

iliashadon [dead]

TLDR: Following my recent blog post and Hacker News post (https://news.ycombinator.com/item?id=48528029). where I ran the desktop app on my M1 Max. Today, I used Edit Mind (my source-available, local-first video indexing tool) to process my YouTube library, 87 videos, 37h of footage in under 24h on a rented RTX 4090 via Docker + CUDA.

Available on GitHub: https://github.com/iliashad/edit-mind

Blog Post: https://iliashaddad.com/blog/i-indexed-37h-of-my-youtube-lib...

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Thank you so much for your support over Hacker News, I wanna share with people of HN. a special discount code "HACKERNEWS", use it here https://shop.edit-mind.com/checkout/buy/9f18a6f0-b437-47ec-b... and get 10% OFF only for the first 5 people and it'll expires

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

I'm not sure if it's possible or not, the goal of my project was to utilize local models and your local machine instead of uploading your videos to the cloud. there's couple of cloud services that offer video indexing very well, I could name a few like Tweleve Labs (I'm not affiliated with them but I did a presentation at one of their webinar).

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That's good, also the Davinci resolve integration works with the Free and Studio version the same way.

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

You're welcome. As of now, the project narrow down your options instead of watching 3-4 videos (5 min each, as an example), you can watch 3 clips from them instead (1s to 2.5s each). It gives you only the video moments that you need to watch for review instead of watching the full videos.

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That's great, would love to hear your feedback then

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Can you check again ? I'm not sure why it's show a cloudflare error

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Thank you! I'm using RAG, I have every video scene indexed individually in the vector database. When I'm asking the agent, it'll use an Ollama model to understand the request, use the available search tool (searching using transcription text, faces, visual, audio or combined) something like when you use Claude or Chat GPT it'll use the web search tool to find you info online. Then, I can filter out video scenes using the Ollama to better present accurate and unique video scene, then send those video results to Davinci Resolve using their API to create a video timeline using those video clips

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That's really great, thank you!

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Fair enough, what would like to see as an example video and I would make it.

For the dog barking videos, those are only the video scenes that I have a dog barking sound in the video.

I'll keep adding more prompts and example videos, keep an eye for that

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Can you please elaborate more?

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

I agree with that, thank you for your feedback. Also, maybe you're not a video editor and you just wanna search your videos. The video editing integrations are optional and you have full control. You can switch between Adobe Premiere Pro, Final cut Pro or Davinci Resolve

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Thank you, would like to know your use case for this kind of project and which prompt you want to genearte ?

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Sure, I'm using (https://huggingface.co/collections/Qwen/qwen25-vl) which can help me understand action like falling down, because I can provide for example 5 frames (down scaled to 720p) to understand what is happening in this part of the video

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

> Aha, it makes total sense. This number sounds much more reasonable than “669 GB”, since the actual total size of processed frames would be like 10-30 GB.

The reason why is “669 GB” is the total raw footage size when I'm doing the video processing, I downscaled each frame to 720p to make the video processing much faster and I don't need full original quality in order to get accurate results (as far as I know and experiment with).

> I’m just curious tho — is there any paying options that can accelerate this kind of process? Just spin up GPU instances?

For now, I found that NVIDIA GPU for example RTX 3060 with 12GB Vram was much faster than my M1 Max. (still working on optimizing for speed and accuracy).

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That's great, I checked your article when it was in front page because someone mentioned my project in the comments.

Good job for the article and the project. That's great, yes local models are getting better and better

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Yes, and it’ll result in much faster results than the ones that I did with my computer

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That’s good to hear, open source ML models are getting better and better. I did a small experiment to generate a Spotify year in review like video here is a preview video https://github.com/IliasHad/edit-mind/tree/expirement/year-i...

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That’s great to know, thank you!

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Not really. Grab frames, lower res, classify, combine metadata, transcribe the audio, convert those data (text, visual and audio) to embedding, save them over a vector DB and SQL DB. Which helped me to do semantic search, RAG, search using a screenshot of the video to find the exact the moment in the video plus search using an audio file as well. And other features unlocked with vector DB

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

I was looking for a solution for this issue of running docker containers over MPS and utilizing their GPU power. I think this project will be the solution for it, I’ll try it very soon and add support for it. Thank you, much appreciated

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Yes, I didn’t look at it. But does it upload your videos to the cloud or process them locally? And does it allow to provide custom faces data to help labeling faces in your videos ?

I think Adobe premiere pro have it as well but cloud processed

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

To your question, I can’t deny or confirm that because I didn’t tried it this project over a Windows machine yet or a machine with this config

iliashadon I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

Why it’s always the same question? Hahah. I posted my project over Reddit and I got the same one hahah