Post on /r/dataengineering: https://www.reddit.com/r/dataengineering/comments/1lagh5z/i_...
25,877 karma · joined September 7, 2007
Data Science Weekly Newsletter (~68k subscribers): https://datascienceweekly.substack.com/ https://twitter.com/datascinews
My email is sgutierr@alum.mit.edu. Open invitation: if you're reading this, I'm happy to receive email about any deep learning / data science / software / startup / etc topic from you at any time.
.
Post on /r/dataengineering: https://www.reddit.com/r/dataengineering/comments/1lagh5z/i_...
Which describes itself as "What's in Space is a realtime 3D map of objects in Earth orbit, visualized using WebGL"
comes from https://mermaid.js.org/
Maybe you could start with something similar?
https://www.reddit.com/r/AskDocs/
https://www.reddit.com/r/medicine/
to see what doctors are saying of your competitors or already existing solutions?
This could give you a good idea of what doctors care about
Given that, here’s a streamlined approach:
1. Extract RFP Content
Azure Form Recognizer, AWS Textract, or Adobe Acrobat API can extract text and structure from PDFs.
If RFPs follow a standard layout, LlamaIndex or LangChain can help chunk and categorize sections.
2. Retrieve and Insert Answers
Use Google Docs API to pull relevant responses based on keyword or semantic search.
OpenAI Assistants API or Claude 3 can rephrase and tailor the responses dynamically.
3. Automate Formatting with a Template
Microsoft Copilot (Word/Excel + SharePoint):
Copilot can fetch Google Doc answers and insert them into a predefined template.
If you standardize the output format in Word, you can generate a PDF-ready final draft.
Alternative: Python + Pandoc + Jinja2 templates if you want a more controlled workflow.
4. Output Final PDF
Convert the formatted document to PDF using Word’s built-in save-to-PDF, Pandoc, or LibreOffice headless mode.
** Low-Code Implementation
If you're looking for minimal coding:
Microsoft Power Automate + Copilot → Automatically extract, populate, and format RFP responses.
Zapier + OpenAI + Google Docs → Retrieve answers, format them, and push to a doc/PDF.
Would Copilot’s Word integration work within your workflow, or do you need more automation for final formatting?
If you want a completely hands-off approach, a small workflow automation script could eliminate the remaining 20% of manual work.
I'm thinking something like:
1. Extract and Parse the RFP
Use an LLM for summarization and section extraction.
Leverage OCR tools (e.g., Tesseract, AWS Textract, or Azure Form Recognizer) if the RFPs are PDFs with scanned text.
Convert the RFP into structured data using LangChain’s document loaders or Unstructured.io.
2. Automate Reusable Content Insertion
Maintain an answer bank (e.g., .txt, .md, Notion, Airtable, Google Docs, or even a vector database like Weaviate or Pinecone).
Implement retrieval-augmented generation (RAG) to pull relevant answers dynamically.
LlamaIndex or LangChain can help fetch the closest responses.
Use Embeddings (OpenAI, Cohere, or Ada models) for semantic search.
If a response needs tweaking, allow the AI to highlight differences and suggest edits.
3. Prompt for Missing Information
If the AI detects missing information:
Generate a draft response using context from existing data.
Provide a structured form/UI (e.g., Google Forms, Typeform, or an internal dashboard) for manual input.
4. Generate the Final RFP
Use LLMs to rewrite responses for coherence and consistency.
Automate formatting with Markdown-to-PDF tools (Pandoc, LaTeX) or Microsoft Word templates.
Consider using Zapier or Make.com to integrate responses into a shared document repository. Low-Code/No-Code Approach
If you want minimal coding:
Microsoft Copilot (Word + Excel) or Google Gemini AI could automate drafting and inserting responses.
Zapier + OpenAI + Google Docs can build a pipeline to parse, retrieve, and generate answers. Notion AI can assist in structured knowledge retrieval.
Would love to hear more about your constraints (e.g., compliance needs, integration with existing tools) to refine this further.
Happy to help here, or hit me up at sebgnotes@gmail.com
How did you choose what you were going to penalize yourself with?
As you can imagine, there is a whole world of kids like your kid who love math and want to do nothing more than math.
If you're interested I can chat with you or recommend resources here if you decide to help your kid do more math.
- I like the great dome - infinite corridor - stata center
- MIT museum
- eat at media lab 6th floor
- baker library under the big dome
- walk around and see the big names on doors
If you like music Berklee is around the corner: https://www.berklee.edu/events
What are your interests?
Are you visiting other schools in the Boston area?
Note, from wikipedia: Q serves as the query language for kdb+, a disk based and in-memory, column-based database. Kdb+ is based on the language k, a terse variant of the language APL. Q is a thin wrapper around k, providing a more readable, English-like interface.
It's sort of like this: https://visualgo.net/en/sorting
Seriously though, the pitch is: "I want to get a job in what you're doing, and you have that job; I'd love to learn more."
Beast academy is around 15/20 a month and apps is more but you can just buy the book and work through it. Richard (the aops co/founder) has a ton of YouTube videos as well.
A third option is aops’s alcumus - which is a free math problem database. We use that a bunch as well and you could use it to figure out what you know and don’t know
- look at keywords they mention
- figure out if you know what those keywords are (what it means, why you would do that, why it's better than prior solutions, some real world examples)
- after a few weeks of this, you'll have a list of companies and words that you're interested in
- go on linkedin (or HN) and look for people working either at those companies and/or using those words
- ask them for a 15 minute chat to hear how they are approaching the problems you're interested in (not for a job, but to hear how they talk about it)
- use what you learned from the previous step to write some blog posts / articles / tutorials / tiny projects that let you see how much you know and then can later show people when you apply to those jobs
- reach out to the groups / companies you want to work and say that you're interested in that area and if you could have a chat about the work they are doing.
- remember that a) everyone is always hiring even if they don't have a job post, b) most job posts never make it public, c) shoot your shot
It's expensive at $50 per month, but it seems highly thought of if you look at Algolia (https://hn.algolia.com/?q=math+academy).
I haven't used it myself, but I am evaluating it for my kids to use.
It's too early to give feedback on that front, though.
- https://sdk.vercel.ai/docs/introduction
And use it with v0 (also vercel)
Particularly liked comparing the current AI / AI Agent hype to the no-code hype.
> I remember in 2015, when I was still in university everybody was telling me that developers are about to be replaced with no-code.
Spot on!
Some past HN posts about it:
For example, Euler wrote 800 articles (in Latin and French) and only 207 have been translated into English.
- http://eulerarchive.maa.org/enestrom.php?topic=trans (link 404s once in a while, so worth refreshing a bit later if it doesn't work)
Examples of works in the French language:
Examples of scans of Math articles that may or may not be in English:
- https://dmitripavlov.org/scans/
A French example from that archive of scanned math articles
Loved this framing: > The point is the fundamental ambiguity of the moment, and that I have to be the one who decides.