Hacker News Reader

Comment by cloudking | Hacker News Reader

Has anyone ever had a problem they needed to solve by asking their PDF a question?

Yes - I write cyber security contracts. I feed it proposals i find from solicitation aggregators and it's suprisingly accurate at answering the below questions about 150 page pdfs.

*Granted, I don't use this service. I use llama index and AWS to store the vectorized prompt files.

Whats the contracting officers email address where the proposal needs to be submitted? What is the Proposal Due Date? What's the full Agency Name? What's a shorter way to say the agency name? What is the RFP number? What type of project are we responding to? Is it a proposal or just a request for information/ Sources Sought Notice? If it is a proposal, simply say proposal. If it is an Request for information or sources sought, say RFI. Are there any vendor upcoming vendor meetings? What is the CALENDAR OF EVENTS? Project Timelines, or deliverables? Can the response be submitted VIA Email? Or is it a sealed bid? What is a description of the scope of work, Scope Of Services or Performance Work Statement? IS the requirement for a Penetration Testing, or Audit Software? How Many Targets are there? Targets consist of Enterprise Systems (Databases, Cloud Enviroments, applications, servers, IP Addresses, Firewalls, network attached storage, and wireless networks ) and Enterprise infrastructure(Switchgears, routers, Modems, HUBS). List the total number of targets by each category. Does it require Social Engineering, Physical Security, Wireless Scanning or Perimieter Security?

Is there something that will allow me to run this locally?! This is exactly what I want to do but no clue how to pipe my data into llama. Any pointers will be highly appreciated!

Locally? It's not really possible to run the model locally, but finetuning on directories is possible.

Here's the code:

It's runs on three different directorys to give me three different 'answers' using an excel sheet to pull the q's from.

   def excelGPT(self, dir, excel_file, sheet):
        #my GPT Key
        os.environ['OPENAI_API_KEY'] = 'sk-
        #Working Directory for training
        # root = 
        root_folder1 = 
        documents1 = SimpleDirectoryReader(root_folder1).load_data()
        index1 = GPTSimpleVectorIndex(documents1)

        root_folder2 = 
        documents2 = SimpleDirectoryReader(root_folder2).load_data()
        index2 = GPTSimpleVectorIndex(documents2)

        root_folder3 = 
        documents3 = SimpleDirectoryReader(root_folder3).load_data()
        index3 = GPTSimpleVectorIndex(documents3)

        file_name = dir + excel_file
        

        df = pd.read_excel(file_name, sheet_name=sheet)

        GSA_answer_array = []
        basic_answer_array = []
        QA_answer_array = []
        df_series = df.iloc[:,0]
        
        for i,x in enumerate(df_series):
            print("This is the index ", i)
            print(x)
            GSA_response = index1.query(x)
            basic_response = index2.query(x)
            QA_response = index3.query(x)
            GSA_answer_array.append(str(GSA_response))
            basic_answer_array.append(str(basic_response))
            QA_answer_array.append(str(QA_response))

        self.zip_to_docv2(dir, "Gippie_Response.docx", df_series, GSA_answer_array, basic_answer_array, QA_answer_array)

This is awesome! Thank you for the code!

This, so much this!

There are so many projects that claim to do this, but end up piping data to OpenAI.

Can someone who has managed to get this set up locally send some pointers our way?

My real estate agent wanted me to sign up a document that is 10 pages long. I would prefer to use the bot to answer my questions, and possibly - verify with other legal things.

Tried the document with the service (after removing personal info), and it worked so-so. Could specify which paragraphs mention the commission, but couldn't extract info about how high the commission is.

Perhaps it's because the document is in Polish. But GPT-3.5 or 4 shouldn't have a problem with such queries.

> Terms of service for various companies and other long and boring documents.

OK, fine. Do you have a working example of this? e.g. he's a contract, and please find me the unfavorable and / or non-standard terms. People have tried this before with no success, and it would be great if someone finally made some headway here. Even more points if the GPT things find onerous terms, but says, "hey don't worry about this non-compete bit, it's not enforceable."

Would using a service like this for legal advice not be one of the more hazardous use cases?

It's a low-stakes scenario, and the alternative was reading it myself - since paying legal fees in this specific case would be prohibitively expensive.

Understandably but my thinking is that when dealing with real estate you are paying for expertise navigating a--typically--large transaction for most people that wouldn't want to rely on an LMM that was trained on a dataset that might not have included the latest laws.

Could be useful for a PDF textbook, perhaps?

Yep. I've been using a similiar service (chatpdf.com) and uploading amateur radio mathematics pdfs and portions of the arrl handbook. I can't quite upload the entire thing due to size constraints, but I've been able to do quite a bit of Q&A from the book chapters.

This Ask your Pdf allows up to 20MB for free vs chatpdf's 10MB free; though chatpdf has a 32MB allowance on the paid plain. Not sure how how ask your pdf plans to monetize this.

I'm personally looking into setting up my own self-hosted "chatpdf/askyourpdf" clone so I can put put a whole bunch of my reference material in there. I can't actually open it up as a service because of the copyrighted works, but I would really love to have ham Q&A site based on the ARRL Handbook and other resources. Even expand that out to an electronics Q&A.

There's a site called llamahub.ai that lets you load lots of your own resources into a LLM index so you can train GPT (or potentially the opensourceish gpt4all variant) on your own resources.

Also want to jump in with https://libraria.dev/ for PDFs too, I just recently updated this with large PDF uploads, you can share your chatbots, have it in different views, and more

Students and scholars alike love it.

I looked up the stat's for crime in my city yesterday.

The police department had a big pdf basically filled with tables. Other formats were not immediately obvious or available.

Asking it to convert it to a spreadsheet would be neat.

Asking it to extract just the locations of interest would be better.

I could see it for instruction manuals.

Upload CheapThermostatUserGuide.PDF and ask, "How do I set the clock?"

PDFs sure are annoying when you want to quickly jump through the docs… but really I wonder how this will do once gpt4 api supports images … maybe then it can help me understand electronic data sheets… cause I’m still trying to figure out was pin 0 the sdl or sda pin… and was vcc 3.3 or 1.8 volts…

„What do I need to learn to understand you?”

You'll be suprised.

Reply on news.ycombinator.com