241 karma · joined January 13, 2023
Also we can use more than just the text output. A human writer doesn't generate a piece of text in one pass. Instead they go through the drafting and editing process. We can design devices to capture keypress or pen stroke(iirc ther were studies on fraud detection based on keypress patterns/mouse movment). One can attempt to train a new model to mimic themselves so we need to somehow make sure that the amount of training data required is too much to be worth the effort.
For downstream testing, the goal isn't mainly to verify whether a piece of text is AI genereted but to make sure that a student who can pass the test would essentially have to know the material sufficient well(so this defeats the purpose of cheating).
https://allendowney.github.io/ProbablyOverthinkingIt/gaussia...
https://huggingface.co/spaces/Qwen/Qwen-VL-Plus
You can also ask it to give you bounding boxes of objects.
Related projects:
https://github.com/ahrm/sioyek
https://github.com/arxiv-vanity/engrafo
https://github.com/dginev/ar5iv
https://academ.us/article/2111.15588/ (powered by https://github.com/jgm/pandoc I believe)
https://huggingface.co/spaces/Xenova/the-tokenizer-playgroun...
Other breakthroughs in graph machine learning https://towardsdatascience.com/graph-ml-in-2023-the-state-of...
Some questions require multi-hop reasoning or have to be decomposed into simpler subproblems. When you google a question, often the answer is not trivially included in the retrieved text and you have to process(filter irrelevant information, resolve conflicting information, extrapolate to cases not covered, align the same entities referred to with two different names, etc), forumate an answer for the original question and maybe even predict your intent based on your history to personalize the result or customize the result in the format you like(markdown, json, csv, etc).
Researchers have developed many different techniques to solve the related problems. But as LLMs are getting hyped, many people try to tell you LLM+vector store is all you need.
There is no way to implement complete censorship without killing your own tech industry.
One comment in the first article you linked said 99% of software engineers in china use github.
The CCP is 100% aware that people use vpn to access foreign websites.
About Huawei stores being empty, some seems pretty crowded at least on the first day. https://youtu.be/YFeE2xHQVRI?si=2-tqnqXj8aF8srN6
Some people see money.
I guess the issue is that people may lose or forget their keys or people can gain access to the signing device. It is harder to understand than using password for verification so people like my parents do not trust it.
You can augment it with retrieval systems(vector store, graph db, sql db + lexical/semantic/graph search) and give it access to tools like api, search engine and code interpreter. Then it becomes an agent.
AlpaGasus: Training A Better Alpaca with Fewer Data https://arxiv.org/abs/2307.08701
Textbooks Are All You Need II: phi-1.5 technical report https://arxiv.org/abs/2309.05463
Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models https://arxiv.org/abs/2307.14430