Hey friends

We wanted to express our heartfelt gratitude to all of you for your support for the EVA AI-Relational Database System last week [1]. The feedback from the HN community has been truly overwhelming :)

We were planning to make an HN post based on these features we have since added [2], but @jonbaer thankfully beat us to it :)

    - Using ChatGPT/LLM + Whisper (Open AI + Hugging Face) models to ask questions based on videos/tables etc. You can check out the notebook here [3].

        LOAD VIDEO 'russia_ukraine.mp4' INTO VIDEOS;

        CREATE MATERIALIZED VIEW 
            TEXT_SUMMARY(text) AS 
            SELECT SpeechRecognizer(audio) FROM VIDEOS; 

        CREATE UDF SpeechRecognizer 
                TYPE HuggingFace 
                'task' 'automatic-speech-recognition' 
                'model' 'openai/whisper-base';

        SELECT ChatGPT('Is this video summary related to Ukraine-Russia war', text) FROM TEXT_SUMMARY;

    - Joining structured data tables with OCRExtractor model output

        SELECT * FROM MyImages 
            JOIN LATERAL OCRExtractor(data) AS T(a,b,c) 
            JOIN LicensePlateCSV B 
            ON FuzzDistance(T.a, B.label) > 50;

    - Vector index support for similarity search [5]

        CREATE INDEX reddit_sift_object_index
                            ON reddit_object_dataset (SiftFeatureExtractor(Crop(data, bboxes)))
                            USING HNSW

        SELECT name FROM reddit_object_dataset ORDER BY
                                Similarity(
                                SiftFeatureExtractor(Open('{path}')),
                                SiftFeatureExtractor(data)
                                )
                                LIMIT 5

    - Using YOLO models to detect objects [6]

        CREATE UDF IF NOT EXISTS Yolo
                    TYPE  ultralytics
                    'model' 'yolov8m.pt';

        SELECT id, Yolo(data)
                        FROM ObjectDetectionVideos 
                        WHERE id < 20

Your feedback and suggestions have already been instrumental in shaping our roadmap and prioritizing new features! We are actively working on incorporating your ideas and addressing your concerns to enhance the functionality, performance, and user experience of EVA. Please email me (arulraj@gatech.edu) with any questions, ideas, or suggestions on EVA.

[1] https://news.ycombinator.com/item?id=35764355

[2] https://github.com/georgia-tech-db/eva/releases/tag/v0.2.3

[3] https://evadb.readthedocs.io/en/stable/source/tutorials/08-c...

[4] https://github.com/georgia-tech-db/eva/blob/master/tutorials...

[5] https://github.com/georgia-tech-db/eva/blob/a6a6ecc7e5c0d9d4...

[6] https://evadb.readthedocs.io/en/stable/source/tutorials/02-o...