HNHacker News
TopNewBestAskShowJobs

timshell

290 karma · joined April 3, 2023

proof of human @ poh.org
submissionscomments
timshell··on Launch HN: Roundtable (YC S23) – Using AI to Simulate Surveys
Pasting below answer to niko001

The data we trained on has year, so we can specify the year you ask the question (the default is 2023). You can also see how answers change over time. [1] shows how the distribution for "Do you support the President" changes from 2000 to 2023 (see the 9/11 spike, end of Bush era, Obama era, Trump era, etc.) [1] https://roundtable.ai/sandbox/2dd4e9d32c24e9abff01810695e948...

timshell··on Launch HN: Roundtable (YC S23) – Using AI to Simulate Surveys
The data we trained on has year, so we can specify the year you ask the question (the default is 2023). You can also see how answers change over time. [1] shows how the distribution for "Do you support the President" changes from 2000 to 2023 (see the 9/11 spike, end of Bush era, Obama era, Trump era, etc.)

[1] https://roundtable.ai/sandbox/2dd4e9d32c24e9abff01810695e948...

timshell··on Launch HN: Roundtable (YC S23) – Using AI to Simulate Surveys
1. GPT out of the box was pretty biased (e.g. gender distribution). We fine-tuned on representative survey data to ameliorate this bias so we get Census-level estimates for conditions such as gender [a] and work status [b].

2. We add the transparency features (click on 'Investigate Results') that shows how in vs. out-of-distribution the target question is. For out-of-distribution, we suggest people run traditional surveys.

More broadly, I think your point is really interesting when it comes to qualitative data. That is one reason we haven't generated qualitative survey data, but a lot of potential customers have already started to ask for it.

----

[a] https://roundtable.ai/sandbox/baa3d5f25236b91f1608c9f606b315...

[b] https://roundtable.ai/sandbox/7a9ee27872eb29087be2386ccd19f7...

← PreviousPage 3 of 3