Hacker News Reader

BAAIBeijingon BGE-Reasoner: An open-source framework for reasoning-intensive retrieval

Hi HN, we're sharing an update on our work to improve reasoning in retrieval systems for RAG and Agents.

Our project, BGE-Reasoner, is an open-source, three-stage framework (Rewrite, Embed, Rerank) that showed strong performance on the BRIGHT benchmark for reasoning-intensive retrieval as of our submission on Aug 21.

Our main contribution is using synthetic data and reinforcement learning to handle complex queries that go beyond simple semantic matching. We're sharing this because we believe the framework itself is a solid, replicable contribution for anyone working on advanced RAG or Agent search.

We're in the process of open-sourcing the model weights, code, and training data to the community.

Love for you to take a look, share your thoughts, and we welcome any and all feedback or critiques. Thanks!

- Github: https://github.com/FlagOpen/FlagEmbedding/tree/master/resear...

- Benchmark: https://brightbenchmark.github.io

BAAIBeijingon Show HN: Emu2 – A Gemini-like open-source 37B Multimodal Model

The current model weights are distributed under the GPLv3 license. The authors are in the process of releasing a new series of Emu2 models that will be accompanied by a more flexible licensing arrangement. Stay tuned for updates.

BAAIBeijingon Show HN: A High-Quality Chinese Internet Language Dataset for AI

Thank you for reaching out with your inquiry regarding our dataset's compliance with the draft "Basic security requirements for generative artificial intelligence service."

I can confirm that our dataset adheres to the data source security requirements outlined in section 5.1 and the corpus content security requirements detailed in section 5.2 of the document. Additionally, we have implemented safety filters to address the main security risks associated with the corpus and generated content, as listed in the annex of the document, which outlines 31 types of potential risks across five categories.

Furthermore, our user agreement explicitly includes terms that mandate the secure use of our services. We take these measures seriously to ensure that our dataset and AI services are not only compliant with current regulations but also maintain the highest standards of data security and integrity.

Please let us know if you require any further information or clarification on this matter.