HNHacker News
TopNewBestAskShowJobs

aortega

1,461 karma · joined August 22, 2011

submissionscomments
aortega··on MechaEpstein-8000
I'm releasing the first (and likely last) version of my AI trained on Epstein Emails. Surprisingly hard to do, as most LLMs will refuse to generate the dataset for Epstein, lol. Everything about this is local, the dataset generation, training, etc. Done in a 16GB RTX-5000 ADA.

Anyway, it's based on Qwen3-8B and its quite funny. GGUF available at link. Also I have it online here if you dare: https://www.neuroengine.ai/Neuroengine-MechaEpstein

And we are discussing it at /r/LocalLLaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1r0eo44/mechaep...

aortega··on Ultrasonic Chef's Knife
But I want a ultrasonic knife.
aortega··on AI-Driven Security Enhancements for OpenBSD Kernel
I'm the original developer and it seems very few people really understand how to use this tool. And I did a poor job explaining it too.

No, I do not think of this of patches to be integrated anywhere. Even if you want to do this, its much easier to review the patches than to write them. But why integrate the patches to the code when you can regenerate them all in hours?

This is a post-processing tool. You add additional checks to your existing code. This will help to catch bugs, (and also perhaps introduce its own bugs), like basically every other compiler-level protection.

But if you catch more bugs than what you introduce, you win. And remember this is done with an very basic AI, next year AIs will produce much better code.

aortega··on Google lays off its Python team
> All AI is written with Python.

Only high-level is written in python, low level is Cuda that is a form of C.

Also, you would think the first to replace workers with AI would be the AI companies like Google.

aortega··on Show HN: Reverse-Engineering a Switch Lite with 1,917 wires
You know that falsely accusing somebody of a crime is also a crime right?
aortega··on Show HN: Reverse-Engineering a Switch Lite with 1,917 wires
Now you have to defend yourself, from a lower position.

See how those people work? now they are assigned themselves the moral high ground, and you have to justify yourself.

Dont do it. You did nothing wrong, those guys are bullys.

aortega··on Show HN: Reverse-Engineering a Switch Lite with 1,917 wires
>don’t know why so many people worship that guy. Same with RMS. Both of those dudes give me the creeps

Maybe because we listen those guys for the useful information and we don't think with our reptile brain that "give us the creeps"

aortega··on Show HN: Reverse-Engineering a Switch Lite with 1,917 wires
> he has explained (while very drunk on a live stream) that he has some beliefs that don't... always align well with the status quo

This is exactly the kind of people that I want to listen on a live stream. And not boring moralizing status-quo defenders.

aortega··on Neurochat: Native open source GUI for LLMs
Neurochat is a opensource native GUI for OpenAI LLMs, LLama.cpp and the free service neuroengine.ai.

It's basically an opensource version of LLMStudio. Currently it works on Windows and Linux, and I have some experimental builds for MacOS too. Apart from being 100% native (using FreePascal) is that with an API key you can access ChatGPT4 using this GUI without having to do monthly payments, you only pay for whatever you use. This is quite useful for me as I don't use GPT4 enough to justify the monthly payments, but I still want to try it once in a while.

It supports local LLMs out-of-the-box using LLama.cpp dll and you can use GPU acceleration if you provide the corresponding accelerated LLama.cpp build for your system.

aortega··on A site to share LLMs APIs via Tor
You can easily limit the damage with a Captcha or similar. Anyway, it survived being in the from page of Hacker News for a couple hours, so I think it's fine.
aortega··on A site to share LLMs APIs via Tor
Currently I do not store any logs, nor I have any use for them. But you should not have to trust my word.

I can guarantee that if you use TOR, I do not have your IP or any other info that can be used to identify any client.

aortega··on A site to share LLMs APIs via Tor
I can handle that with automatic throttling, unless you want to spend a lot of resources doing a malicious attack.
aortega··on A site to share LLMs APIs via Tor
Yes, it's coming tomorrow.
aortega··on A site to share LLMs APIs via Tor
Added the 2-clause BSD license. Thank you for bringing it to my attention.
aortega··on A site to share LLMs APIs via Tor
There will always be a delicate equilibrium between freedom and security. This site provides a greater degree of freedom compared to other services; however, it still necessitates registration for the purpose of sharing AIs. If you employ it to disseminate malware links, you will promptly face a ban. Nevertheless, apart from potential throttling in the event of excessive usage, there are no other restrictions imposed.
aortega··on A site to share LLMs APIs via Tor
Sure, the API is a very simple json request.

Currently, registration is needed for the sharing of AIs, as you rightly mentioned, to prevent malicious individuals from distributing malware links. However, accessing the AIs does not necessitate registration. This is because, depending on your definition of "bad actors," users have limitations in terms of what they can presently accomplish with an AI, even in an uncensored state.

aortega··on A site to share LLMs APIs via Tor
Generative AIs are perfect for TOR, as the are low-bandwidth, high-latency services.

I should say that I cannot accept all the credits for doing the site, as it was made 90% by the AI itself (under my direction, I hope).

aortega··on A site to share LLMs APIs via Tor
In light of upcoming regulations on artificial intelligence (AI), I created neuroengine.ai, a website that shares large language models (LLMs) in the form of chatbots and APIs. The site is accessible through Tor hidden services, allowing users to access state-of-the-art uncensored AIs anonymously. Currently, there are two 65 billion parameter class LLMs and a couple smaller fine-tuned AI models available for free with no API limits, and no registration required.
aortega··on Alpaca: A strong open-source instruction-following model
Llama.cpp takes advantage that LLaMa 7B is a tiny, very optimized model. It would run in anything, and very fast. I really doubt you can run the 30B or 65B models at acceptable speed on a CPU at least for a couple years. (I'm ready to eat my words in a couple weeks)
aortega··on Alpaca: A strong open-source instruction-following model
>can lie so convincingly that it does not know that it is lying.

A human can also lie convincingly.

The problem with AI is that you can do it massively.

aortega··on Alpaca: A strong open-source instruction-following model
LLaMa_65B answer is similar:

SYSTEM: You are an AI research assistant. You use a tone that is technical and scientific.

USER: Hello, who are you?

ASSISTANT: Hi! I am an AI research assistant. How can I help you today?

USER: Tell me something about owls.

ASSISTANT: Owl is the common name for birds of the order Strigiformes. They belong to the class Aves. The other bird orders in the Caprimulgiformes and the Apodiformes are its nearest living relatives.

aortega··on Alpaca: A strong open-source instruction-following model
That is still a 4000 usd computer. You can get 2 RTX3900 used for ~1000 usd and run 65B much faster.

I have a discord server up serving almost 500 users with 65B.

https://twitter.com/ortegaalfredo/status/1635402627327590400

For some things is better than GPT3, for other even Alpaca is better.

aortega··on Celery-ai: Multiplatform OpenAI keyboard integration
This is a simple tool that integrates OpenAI ChatGPT and Davinci models by hooking the PC keyboard. It currently works on Linux (Mac and Windows are still buggy). It requires a OpenAI api Key.

IMHO keyboard interface with AI should be the fastest and more convenient, even more than voice or some future brain-link. Using the keyboard is fast (you can often type faster than you think) and silent, ideal for incorporating AI to your daily work.

Being 100% python, Celery-AI is easily installed via pip.

aortega··on Coinbase Launches Base
It's useless to reply to that guy.
aortega··on Coinbase Launches Base
>t still completely unacceptable and ridiculous

55 kilowatts is a single car. One car. How many datacenters has your bank? You have a very mistaken idea of computing power and efficiency if you think a Raspberry Pi is more efficient than a server CPU.

aortega··on Coinbase Launches Base
Ethereum (which this is based on) do not use PoW anymore, so it consumes very few resources.
aortega··on Liu Cixin's Technologies of the Future
>indestructible intelligent nano-scale machines that can be anywhere any time

They are not nano-scale, they are planet-scale, 11-dimensional computers projected into 3-dimensional space.

aortega··on Liu Cixin's Technologies of the Future
There are much more ideas, I.E. (Spoilers!) dimensional attacks, slow light-speed areas and their effects, math attacks, destruction of the fabric of spacetime, nano-scale multi-dimensional computers, whole universes trapped inside elemental particles, etc. There are so many interesting plots that each one could be an entire book on his own.
aortega··on Liu Cixin's Technologies of the Future
You need to physically send a Sophon for it to enable FTL, so the first message is not faster than light.

Near the end I think future civilizations communicate via dimensional membranes or some magic-technology like that, but it doesn't reveals your position either.

aortega··on Liu Cixin's Technologies of the Future
This trilogy is the first one that I read that is on the same level, or even better, than Asimov's novels.

Concepts and ideas here are much bigger, but there are so many cramped into every book that sometimes it feels like a Rick & Morty show. And I like that the point of technology is that no matter how advanced you are, there is always a bigger fish.

Page 1 of 19Next →