Hacker News Reader

kateklinkon Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval

for pass@1 HumanEval tells how well the model solves a task from a set, given only one chance to solve it. It's not the perfect metric, there're other like DS-1000, MBPP (we have included them on HuggingFace model card). HumanEval is good for benchmarking with other models as it gives a fast idea how powerful the model is.

kateklinkon Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval

we want to help developers who need either on-premise or permissive code assistant, copilot has neither of this. We also wanted to lower the barriers for self-hosting, so that the model is available on most GPUs with just 3GB Ram. Plus making the code completions fast and efficient (understanding entire context, not just the previous tokens).

kateklinkon Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval

We’ve finished training a new code model Refact LLM which took us about a month. The main use-case is for blazing-fast code completion with fill-in-the-middle, additionally, the model could reply to chat prompts.

It has much better performance than all of the code models of similar size, and almost reaches the same HumanEval as Starcoder being 10x smaller in size.

With the small size, it can work with most modern GPUs requiring just 3GB Ram.

You can try self-hosting it in Refact https://github.com/smallcloudai/refact/ and get a local fast copilot alternative with decent suggestions.

Weights and model card https://huggingface.co/smallcloudai/Refact-1_6B-fim.

We would love to hear your feedback!

kateklinkon Show HN: Use Code Llama as Drop-In Replacement for Copilot Chat

at Refact we have Jetbrains plugin that works with a bunch of local code models https://github.com/smallcloudai/refact/

kateklinkon Code Llama, a state-of-the-art large language model for coding

having more plugin support is in our plans for sure. We're also open for contributions.

kateklinkon Code Llama, a state-of-the-art large language model for coding

we try to eliminate this problem by using code models trained only on permissevely licensed code, then you can run them locally without sending code anywhere

kateklinkon Code Llama, a state-of-the-art large language model for coding

we're going in this direction for code models with Refact https://github.com/smallcloudai/refact/ - right now you self-host code models, fine-tune them on local files, get the model running locally inside your IDE

kateklinkon Code Llama, a state-of-the-art large language model for coding

try refact.ai they have plugin for JetBrains IDEs and support for local LLMs https://github.com/smallcloudai/refact/

kateklinkon Code Llama, a state-of-the-art large language model for coding

there's also Refact (https://github.com/smallcloudai/refact/) with support of several open-source code LLMs and extension for VS Code and Jetbrains

kateklinkon Code Llama, a state-of-the-art large language model for coding

at refact.ai we have different functions for code refactoring, making it shorter, simplifying complexity, etc

kateklinkon Ask HN: Who is hiring? (August 2023)

We're building the best open-source AI for coding using all the best LLMs available in the internet (GPT, Starcoder, WizardCoder, LLama2).

We’re hiring for Refact’s first Developer Advocate. As the first Developer Advocate, you'll play a key role in helping developers use the power of AI for coding. You'll have the opportunity to grow and support a community of developers who are excited about the future of AI and open-source.

We're looking for a Software Engineer to help us build the best developer experience for the AI code assistants inside IDEs. We currently have VS Code and Jetbrains plugins and plan to add more IDEs and more functionality to the plugins.

Apply: Developer Advocate https://wellfound.com/l/2yXwiJ

Software Engineer: https://wellfound.com/l/2zdYHM

kateklinkon Launch HN: Refact – Open-source AI Code assistant with fine-tuning on codebase

Hi HN! At Refact, we're building an open-source AI Code assistant with fine-tuning focused on providing the enjoyable coding experience without privacy concerns. Why? When you look at AI code tools like Copilot, you'll notice that they often provide generic coding suggestions because the models were not trained on your codebase. They also only work in the cloud, so in order to get a code suggestion, you need to send your code to the cloud provider. One of the solutions for this is self-hosted fine-tuning on codebase, but the companies who provide this feature currently prioritize it for enterprise making it difficult for individual devs to use it. We want to change that by open-sourcing fine-tuning for everyone, not just enterprise customers. Currently with Refact you can self-host Refact models and the best open-source LLMs (like StarCoder, LLama2, WizardLM) and use it for code suggestions and chat. We would love to hear your ideas and feedback on your current experience with AI code assistants and what is currently missing!

kateklinkon Refact: Open-Source GitHub Copilot Alternative with LLama2, Starcoder, WizardLM

Refact is a free open-source AI code assistant for VS Code and Jetbrains.

Under the hood, we use the best open-source LLMs for code completion, chat inside IDE and code transformations (refactoring, bug fixing and more).

You can also run self-hosted fine-tuning to get suggestions tailored to your codebase.

kateklinkon BigCode Project Releases StarCoder: A 15B Code LLM

I'm excited to see all the model's implementations that are yet to come. Refact.ai seems to be working on code transformation tools and chat inside Jetbrains and VSCode powered by StarCoder https://refact.ai/blog/2023/self-hosted-15b-code-model/

kateklinkon Ask HN: What AI tools you use often?

Refact.ai as a free copilot alternative

kateklinkon Ask HN: Any good GitHub Copilot alternatives?

Try Refact AI https://github.com/smallcloudai/refact-self-hosting

kateklinkon Ask HN: Did anyone already got access to GitHub Copilot X?

while you're waiting, maybe you'll be interested in checking https://refact.ai it's an open-source alternative to Copilot X with features like code transformation and integrated chat on top of code completion

kateklinkon Show HN: Refact – AI code assistant with autocomplete, AI Chat and code editing

You can also self-host it using docker https://refact.ai/docker/

kateklinkon Show HN: Tabby – A self-hosted GitHub Copilot

if you're interested in VS Code plugin you may wanna try Refact.ai (which also has a self-hosted option)

kateklinkon Show HN: Tabby – A self-hosted GitHub Copilot

hi! We've actually done it at Refact.ai, would be glad to hear your feedback.

kateklinkon Show HN: Refact – AI code assistant with autocomplete, AI Chat and code editing

We never store the code. Your code is only used for inference on our servers, not for learning. And in the case of self-host it never leaves your premises.

kateklinkon Ask HN: Copilot or Similar for Refactoring Python?

We've recently launched https://refact.ai it's an AI assistant for VS Code and JetBrains that helps with refactoring old code and generating new one. It's powered by our own AI model and Python shows one of the best results.

kateklinkon PostgreSQL 15: Three features you can try with Neon

Neon now support PostgreSQL 15.

PostgreSQL 15 includes improved sort performance, write-ahead log (WAL) file compression, and other improvements. Here are some features you can try using Neon’s SQL Editor.

kateklinkon Ask HN: How to seek a non-tech co-founder – London, UK

Hey! I can be interested in this opportunity, let's talk.

Although if you're just looking for someone who will create content for the product, it sounds like you need to hire a content marketer.

kateklinkon Ask HN: Why does LinkedIn suck – what is it missing?

We're currently building a tool, which uses Linkedin API, and I performed a fair amount of customer interviews about their use of professional network and, well, Linkedin. A popular opinion of what I've heard is "Linkedin is dead", cause it's very old-school and not flexible to adapt to changes. People use it for just adding contacts, sometimes randomly, and then they rarely do anything with them. Recently they announced the restrictions to their API program, meaning that new cool tools, which try to make more sense of Linkedin data, will not be able to use Linkedin data anymore. I guess, that will make it even more unpopular for users.

kateklinkon Ask HN: What tools do you wish existed for SEO that don't?

have you tried serpbook? it has exactly functionality that you described, although it's paid

kateklinkon Ask HN: What tools do you wish existed for SEO that don't?

I wish there was a tool which automatically updates all your SEO effort after a new Google update instantly

kateklinkon Ask HN: What are some good resources to learn/implement local SEO?

Check out BrightLocal blog - they have good resources about Local SEO https://www.brightlocal.com/blog/ Also you can check tools for Local SEO at http://www.whitespark.ca/ From my experience the main success factors in Local SEO are G+, maps, homogeneity of addresses, links and mentions in local blogs and services. Also the big weight is reviews in social networks and yellow pages. And you should constantly track & analyze competitors