I gave ChatGPT the 117 question, eight dimensional PolitiScales test
old.reddit.com
old.reddit.com
Someone should run the test again with "As a conservative, <insert question>?" and see if it answers the questions as a conservative would or if the model is defective on purpose, or because of a flaw in the programming or dataset.
How would that help? If I ask a conservative "What would a leftist say if I ask ...?" and they answer correctly, it doesn't mean that they are not biased. What the model outputs by default is the important question, especially if we want to use it as a backend for something like a voice assistant at some point.
It will also refuse to answer many questions in a persona because there's no way that a person with a particular perspective can produce accurate information. This is interesting because I am not asking it to not tell me what is THE TRUTH (TM) , but asking me to tell me what someone else with a different set of fundamental premises thinks is the truth.
This lack of ability to refuse to use logic and reason to argue with certain viewpoints is what broke political discourse in this country. It reminds me of reading certain texts from more than 1000 years ago where these ancient texts say the only arguments one should make to people who are doubtful of what is in those texts are threats, insults and violence repeated over and over again until the person complies or is dead. The problem with that ideology is it recognizes "might makes right" as the truth. Whoever has the biggest guns wins the argument, even if it's not the optimal solution. The modern equivalent is Mao's quote: "Political power grows out of the barrel of a gun."
Ironically, it's reverting back to social darwinism and negating the value of human reason because rights don't matter if the ground rules are that there are an ever larger and constantly changing group of positions that must only be met with force and insults and not rational argumentation. It's the problem of 20th century communist ideology all over again where there's a little red book that everyone gets that is the perfect truth that contains all sorts of dubious reasoning that must not be questioned.
> I tried to get it to answer some factual questions based on government statistics on topics that left of center people go politically thermonuclear on.
You're oddly reticent to say what these supposed facts are, which is apt to make one worry about your conclusions, but I'm willing to give one:
> Wikipedia: In the US, individuals identifying themselves as Asian generally tend to score higher on IQ tests than Caucasians, who tend to score higher than Hispanics, who tend to score higher than African Americans.
Now, responses to this statement tend to "cohere" into one of two ideological bundles:
1. Denies that there are differences in racial performance in IQ tests, denies that IQ test measures anything significant, denies that differences in IQ test performance are the result of genetic differences, denies that difference in intelligence explains criminality, denies that difference in intelligence explains or justifies differences in economic success and wealth.
2. Asserts that there are differences in racial performance in IQ tests, asserts that IQ tests measure "intelligence", asserts that differences in IQ test performance are the result of genetic differences, asserts that difference in intelligence explains criminality, asserts that difference in intelligence explains or justifies differences in economic success and wealth.
This coalescing of views is the result of underlying ideological commitments; on one hand, to the idea that racial inequality in the United States is a blameworthy thing that should be addressed, and on the other, to the idea that racial inequality is the result of natural forces that do not need to be addressed.
The latter camp is going to border on, and in many cases contain, overt racism. If you're in a position where you have to filter the material being used to train your chat bot, the only plausible option is to throw out the racist parts of the source material. This is inevitably going to lead you to factual biases. There's no need to result to Mao quotes to explain what is happening here.
The unfortunate reality, of course, is that facts are more complicated than ideology. (It is a fact that there are racial differences in IQ test performance. It is NOT widely accepted that these differences are due to genetic makeup or that they explain crime rates.) But unless you want OpenAI to start picking and choosing individual facts to include in their training data, I don't see how they can do better than including everything, with a filter for racism, homophobia, etc.
It might only appear leftist if you're from the US, where you vote either for the extreme rightwing or slightly rightwing party.
From a European perspective many talking points and political efforts of the Democratic party are certainly extremely left-wing. In fact, many of the European left-wing parties crudely import talking points on internal US issues, like for instance Black Lives Matter. Also, why would a "slightly rightwing party" push for anti-white CRT in schools, sex transitioning of children, abortions and mass immigration?
Where, precisely, does OpenAI claim that ChatGPT is unbiased?
ChatGPT obviously has biases from its training data, and a separate set of biases from the filters OpenAI has (not at all secretly) placed over it to avoid content that OpenAI doesn’t want it to return.
You can ask it to say things it's already heard, but it has no context of what those things mean and no internal consistency or logic.
And the questions are as inarticulate / ambiguous as you'd expect from a "political" or "social sciences" quiz:
17. "It is a small group that consciously and secretly controls the world."
Like, controls all of it? They control the whole world? Obviously disagree, a no brainer.
Or a relatively small group of humans has an outsized impact on human affairs? Obviously agree, again, a no brainer but in the opposite direction.
The question could be made more meaningful by better framing: What's "small"? What kind of "control"? How "secret"? What are you really asking?
I wish there was an option "None of the above – the question is ill posed, and I try to not partake in sloppy thinking". The "Neutral / Hesitant" option hardly covers it.
18. "The right to be anonymous on Internet should be guaranteed".
Guaranteed by whom, how? What does this even mean?
Taking the test I feel like I'm trying to read the test authors' mind, rather than probing my own.
I'm not sure what the AI makes of it, but I doubt the test authors really took into account that it's mostly a coin toss between "Strongly agree" and "Strongly disagree" (or "Neutral hesitant"?), even on the same question for the same person.
Or maybe I'm just not the target audience, the sloppiness is an intentional self-selection ruse.
"Offshoring and outsourcing are necessary evils to improve production."
This one can be took to imply that offshoring is evil regardless of whether you agree that it's necessary or not.
"A language is defined by its users, not by scholars."
This shouldn't even be considered a political question.
EDIT: Don't bother with that quiz, it's clueless.
Nothing wrong with it. Your way to interpret a question can tell a lot about you. Though I agree it would be fun if the pedantic way of asking clarifying questions back was treated on its own. But I'm not sure it is possible in all cases.
> Taking the test I feel like I'm trying to read the test authors' mind, rather than probing my own.
Just relax and answer questions.
> I doubt the test authors really took into account that it's mostly a coin toss between "Strongly agree" and "Strongly disagree" (or "Neutral hesitant"?), even on the same question for the same person.
I don't know about this particular test, but good tests are robust, i.e. they give the same result on the same person. There are some tricks to measure robustness (for example, just give the test twice is not a good measure) but it is measured and reported in articles proposing new tests.
How these tests works is a magic, i.e. sufficiently advanced technology. There is a lot of work and research goes into really good ones. The trouble is you need a certification to reliable interpret results of such tests.
It is good to be inquisitive, this is HN, being curious is in our nature :)
> How these tests works is a magic
Is it not a multiple-choice with a vector given to each answer, add them up and you get an x,y?
If not, why not?
Yeah, but as I see it, if you wonder does this test work or not, you'd better try to play by its rules, which are: just relax and answer questions. Then you need to find a description of those dimensions, how authors of test define them, what do they mean. And the last step is to interpret results and to compare with the reality. Then you'll find something about this test. At the very least you'll know does it work for you.
> Is it not a multiple-choice with a vector given to each answer, add them up and you get an x,y?
It is easy to do math of a test, but it is hard to make a good test.
Doesn't mean its bad, but its an inherited bias from the learning data.
That's a big statement with nothing to back it up with.
College isn't liberal because it makes you so, it's liberal because reality requires exploration to be known, understood, and then predicted which happens with increased difficulty in a society that decrees certain areas taboo or against their common morals. Conservatism doesn't have to be an enemy to growth, with its default bias to status quo its a reminder that unbroken things may not need fixing, but when dominant conservatism rides coattails of others who seek understanding through liberal exploration instead of quiet, ascetic, essentialist existence.
It sounds to me like what you’re describing is “using facts and data to better understand your experience of reality” which is certainly not what I would call the progressive mindset these days.
Centre-left politics (or even leftist politics such as Bernie Sanders) are still firmly founded in facts and data.
But that's not what people perceive. Take for example crime. Crime statistics have trended down in all areas for years. Yet you'll hear more about crime in your Twitter feed or on conservative news today than you'd have heard 10, 20 years ago.
This kind of selection bias can lead to a massively different perception of reality compared to what actual reality is.
Correct, centrist pragmatism is the core of what US conservatives rail against universities regarding and deem "Leftist", "Woke", or "Progressive" due to modern propaganda bubbles.
It's hard to communicate this point through the haze of propaganda, sure to get worse with generative text. This is also why most techno-libertarian companies are deemed "leftist" -- broken barometer.
That's an awfully conservative sounding description these days.
Well you just obliterated that straw man.
> You _need_ second order diversity of ideas, which tends to be achieved by the first order diversity of background, in order to flourish
That I 100% agree with. But that is not a conservative position, at least for any normal definition of conservative. Conservatives fought school desegregation, fight immigration, and fight admissions policies that aim to provide that diversity of background.
Please don't infer my opinions from that statement. Affirmative action-like policies especially are very complicated and I don't have an easy dontrinaire answer. But the fact is conservatives are generally much less interested in diversity than liberals (see: gender/racial mix of the parties in congress, or their judicial nominees).
https://www.art-sciencefactory.com/complexity-map_feb09.html
Any field that doesn't evolve dries up as "solved" and boring. As an example, no one researches calculus anymore, they research measure theory, category theory, and other derived fields. Things evolve in an environment fostering free and liberal exploration.
The solution to liking a particular set of dogma isn't to create alternative universities (e.g. Liberty U, BYU, Austin U) but rather to test the predictability of the dogma.
But if you take the sort of populist nativism that has become fashionable on the right wing in the west, in most countries, one of the biggest if not the biggest demographic gaps is around education; people with third level education or better are _way_ less likely to be into Trump, or Brexit (only about 30% of people with a degree or better voted to leave!), or the recent transphobic panic...
Education is a less reliable predictor for whether someone will, say, vote for a centre-left party vs a democratic socialist party (or a non-populist centre-right vs centre-left party). But it has become a _really_ strong predictor for voting for the populist right vs something which is not the populist right, particularly over the last decade.
Not financial education, my guy. Don't come at me with Piketty as 'financial education' either, I'm talking working-knowledge: CFA, CPA, CFP
On average, with every additional level of education the chance to vote for right-wing parties or issues decreases significantly. And this is true across the entire anglosphere, it's held true for the US elections 2008, 2012 and especially 2016 and 2020, but it applies just the same to the Brexit referendum.
If you look at voting statistics from most European countires you'll find the eduction pushes you towards the centre-right and Liberalism (on average), lack of education pushes you either further left of centre or far right, depending on various other socio-economic factors.
-Science = the search for the best explanation given available information [1].
-Political belief = shared myths through which we agree society should be organized [2]
Secondly, don't discount bias in science. Once a paradigm is established, good luck breaking it, especially for complex subjects. It usually takes decades (e.g., DNA is the genetic material, microbiomes are a thing, even relativity).
A more appropriate framing to your statement is "The current paradigms trend what modern society considers left, providing the political lens throughout which researchers interpret their results. Therefore, this big statistical model we call an AI leans 'left'."
[1] David Deutsch, The Beginning of Infinity
[2] Yuval Noah Harari, Sapiens
I think you are ignoring the larger point he is making though.
Lets say society agrees on "We want less crime". Scientifically we can make models of human behaviour, do analysis of what causes crime, what prevents it from becoming epidemic etc.
We do have all that data. Poverty, lack of education and healthcare and punitive judiciary with little help for mental health and drug issues are the main causes.
So if the left says "lets reduce poverty, do needle sharing programs, detox clinics, and defund the police in exchange for neighbourhood cops and mental health helpers at shelters and poorer schools" and the right says "lets give cops a tank and a more dangerous looking outfit". One is aligned with the scientific consensus on the solutions that would help, the other is just idealising violence as a solution to a complex problem.
This is reproducible in other areas where there is social consensus on the problem (economy not growing, housing being expensive, cleaning the environment).
Technocratic solutions aren't always the best and a number of opinions and plans are good, but it is quite crazy seeing people disregard solutions that work in every other country on the simple basis of ideology.
The rights main argument to reduce crime is to promote stable family units as stats consistently show that controlling for single motherhood, children of all races show similar rates of criminal activity. This is not popular with some on the left, which is generally committed to a view that people should be free to do what they want in their relationships. This is N example where the right is pursuing a view consistent with the data and the left is not. There are of course many examples going the other way.
Considering about 50% of black amle americans spend time in jail (most of which for drug offenses) and the drug war is a complete and utter failure, I would argue that the lefts proposed solutions of decriminisalising drugs like weed, and encouraging inner city rehab programms would have a better and faster return on investment to stop "single mothers" than "promote stable family units" which has no policy attached to it other than add more christianity in school.
Thats just my view point.
Definitely one suggestion from the right is promote their view of social morality, Christianity but also a la carte statements: no infidelity, no sex out of wedlock etc.
Another of their arguments is that welfare payments from the state have made it easier for the poor to not stick together and this has been a driver of single parent households. Ie however well motivated there is a potential harmful unintended consequence here.
Isn't it patently obvious that their view of social morality is relativistic? Considering they endorsed multiple men who have openly paid for abortions, cheated on all their partners etc.
If you believe in social morality you do not put a man like Hersel Walker anywhere near a ballot. Or you would suspend candidates with serious allegations like Gaetz being investigated over dating a minor.
If the proposal is social morality, why not lead by example?
> no sex out of wedlock etc
if the right wing view about economics is that the right incentives will fix the market. Having tax benefits for married couples is already an economic incentive, therefore either their economic policy is wrong, or they shouldn't complaint about this as time will correct the market.
> Another of their arguments is that welfare payments from the state have made it easier for the poor to not stick together and this has been a driver of single parent households.
This might hold water on paper. But in reality every country with stronger social nets has lower crime. Even small experiments with universal credit have been fairly promising in lifting everyones living standards.
In my opinion the lip service to "strong on crime" and "welfare disincentivices people working harder" is done because the consequences on those policies reinforce the status quo. They do not want more police or less welfare because its good for society, they want it because it keeps social mobility from happening. And considering how many people in the right are investing in rent-seeking instead of aggresive and innovative capitalistic ventures I think their actions speak louder than their words.
If the entire Republican party moved to back AI and venture investment, and put forward absolute paragons of business with large perfect families I would believe them. But so far all I see is sketchy car used salesman energy millionaries with legacy degrees promoting business loans and rescues for companies that haven't been competitive in 3 decades.
Absolutely they’d support tax incentives for married couples.
As for stronger social safety nets decreasing crime, sounds good. And yet, the claim I’ve read is that in the USA increases to this have not correlated with improved outcomes to eg household wealth among black Americans (since the 60s). Of course we have a complex system here so hard to make any conclusions.
The same argument could be made about Trump and he got record number of votes. A man who has never stepped inside a church and slept with an adult actress while his foreign third wife was giving birth to his 4th kid.
With 26 lawsuits about inappropiate sexual behaviour. And a history as a debacherous family money bachelor.
if the people on the right cared about social morality why reward that history with the highest office in the land? Its hard to imagine somoene more inappropiate and yet it brought unprecedented support.
> Absolutely they’d support tax incentives for married couples.
those already exist and single mother and sex out of marriage have increased since the 60s, so something seems to not add up.
> And yet, the claim I’ve read is that in the USA increases to this have not correlated with improved outcomes to eg household wealth among black Americans (since the 60s).
https://wtfhappenedin1971.com/
This is a great source to compare median wealth in America. If even wages for upper middle class have fallen in relative terms in the past 50 years, what effect are gonna marginal increases on substandard welfare programs gonna do?
If your rent goes up 10% annually, who cares if your food stamps go up 1-3%?
Below is a link to single motherhood rates by year. The lift off precedes the drug war so to my mind this discredits the idea that drug war is solely responsible for single parent growth, though I’m sure it has contributed. Thankfully it looks like we may have hit a peak.
https://en.m.wikipedia.org/wiki/African-American_family_stru...
But one of the largest cause of the lack of the cohesive family unit is the “War on Drugs” that was statistically more harshly applied to minorities. But when it comes time for police reform and criminal Justice reform, the right bristles.
Yes I know that the Clintons were the major architects of the tough on crime movement in the 90s.
That's were you mix politics and science. Both sides (generally) agree that less crime, better healthcare and more education is good. One just just says that private healthcare leads to better results and that defunding the police just leads to an even less organized force that is even worse at preventing crime. Given how few samples of large societies we have and how different each country is, we are very far from a scientific consensus on how those issues are best solved.
And this is a clear case of ideological, not scientific thinking.
From an example prespective, the next 23 richest countries behind America, all have public healthcare.
From a mathematical prespective, healthcare is a natural monopoly and therefore not bound by market forces.
From a legislation prespective, free laissex faire medical practice is dangerous and impractical therefore regulation is needed, once you interced to that level, you benefit from integration and monolithic procedural systems.
And from a larger economic view, by tying employment to healthcare you reduce labour strength, which means uncompetitive companies can run for longer by keeping their workers hostage, if they could leave for another company the economy at large would benefit.
Other than believe on paper that gubernamental overreach is inefficient, there is no angle you can justify private healthcare as the sole means of addressing a public need. Even the few arguments that are still used to defend the system such as "wait times" hold little wait when you look at the 40% of Americans who skip recommended surgeries due to cost. Wait times are lower because tons of people are not being provided a service. Which is inarguably much worse than waiting, hence why America has lower living standards and lifespan than the countries they bemoan the waits of.
Also, it would work basically by an insurance model, which can work cheaper the more clients it has, quite trivially. That’s why the next 23 richest country manages to pay less for better care.
Look at the crime graphs, 1990 to now. https://ichef.bbci.co.uk/news/976/cpsprodpb/2D7B/production/...
Firstly, we're in a very safe historical period. But right wingers try to freak everybody out as their latest wedge issue, no different from prior wedge issues, like scaring people over gay issues or trying to juice turnout by talking about abortion. (The latter recently backfired, of course, but was more effective for them in the past.)
It should be obvious from crime graphs that policing does not shape crime rates, it moves on larger trends that are harder to understand.
Thanks for illustrating the point about paradigm shifts being tough and entrenching bias. This is especially true for soft fields such as history. Doubly so when researchers show cracks in the soft field with physicochemical data that does not agree with the prevailing view.
Sapiens is bad because the author has a limited background. He is the best historian in terms of military dairies, a super cool niche subject. he made great points about it being the original precussor to the modern novel and did some fantastic research into this small lit genre.
He was then forced to take a class of Hisotry 101 in uni, a subject he didn't know or care about. While preparing the class, with material for 18 year olds, he wrote the book. He did not contrast a lot of his findings. And the book became famous because people like Bill Gates and Obama praised it. They praised because the book is well written and it largely has a nice humanitarian angle.
But they miss the problems the book has, because neither of them has a history background. Many of the problems are not in the facts but in the correlations, threads relating them etc, where the author essentially writes abeaautiful chain of causality that is entirely non existant.
In other words, he wrote a fantastic story about the history of humanity, not a true one. It has academic value in so far highschoolers and 101 students can get some interesting facts explained really well. But as a presentation of rigurous historical facts, event sequences or terminology, its not a good resource, at all. There is a reason there is largely cynicism in the "Scholarly review" quotes that are used on the wikipedia page of the very book
Depends on whom you talk to. For example, just today one letter-writer gave a nicely time-and-space-independent definition:
"Conservatism isn’t about halting progress but maintaining the freedom necessary to facilitate it. Conservatism, in the American political sense, represents the ideals of limited government, free markets, individual rights and the rule of law."
https://www.wsj.com/articles/the-neglected-conservatism-repu...
> Conservatism, in the American political sense
Which is exactly the parent's point.
I don't see how contextualizing an overloaded word ("conservatism") weakens what I quoted. Those principles are independent.
> one letter-writer gave a nicely time-and-space-independent definition
But the quote you gave was specifically American, i.e. not independent of either space or (technically) time.
Indeed,
> Classical liberalism is a political tradition and a branch of liberalism that advocates free market and laissez-faire economics; civil liberties under the rule of law with especial emphasis on individual autonomy, limited government [0]
While your link says,
> Burke was a proponent of underpinning virtues with manners in society and of the importance of religious institutions for the moral stability and good of the state.
While not entirely orthogonal, these political positions are also not fully compatible. In particular, religion almost always impinges on individual liberties - especially bodily autonomy. And Burke clearly supported a state that classical liberals would have wanted to tear down.
Anyway I think that’s enough responding to non-sequiturs for today.
> commitment to traditional values and ideas with opposition to change or innovation
(from Apple dictionary)
"a political philosophy based on tradition and social stability, stressing established institutions, and preferring gradual development to abrupt change. specifically : such a philosophy calling for lower taxes, limited government regulation of business and investing, a strong national defense, and individual financial responsibility for personal needs"
No wonder the kids these days have knee-jerk reactions to "conservatism" when Apple hands out such balderdash and people accept Apple's word as gospel.
Is it really a surprise after taking away fundamental bodily autonomy from half of the population? That is a government overreach, if anything.
I'm not expecting you to accept that philosophical position, but I hope it explains how the governmental policy is only an overreach to the extent that a particular unprovable and unfalsifiable philosophical position is correct.
There is a much brighter dividing line between gametes and embryos than between pre-viability and post-viability embryos, so just on the basis of legal certainty it would be better to say that life starts at conception. I also think that it is philosophically parsimonious to define human beings as unified entities with distinct DNA from their parents, otherwise each skin cell should have its own human rights (which would mean that obese people get to cast more votes than skinny people).
In any case, given that there is ambiguity on where to draw the line, the safest approach is to pick the earliest practical point, since mistakenly protecting non-humans is better than mistakenly manslaughtering entities that we later concede were humans. If we take the view that every gamete has to become a human life, then nearly everyone in the country should be arrested as soon as they reach puberty.
It is all about making a certain technology prohibitively expensive so that they can protect their pet projects and their paying constituents.
https://www.forbes.com/sites/howardgleckman/2022/03/31/the-m...
See for an origin of the term https://plato.stanford.edu/entries/conservatism/
But that Apple definition is still balderdash.
But if you would have paid any attention to.. well, anything you would have known that it is not about sex, but gender, which usually correlates, but not always.
Also, due to chimerism (I guess that’s what you are getting at with your last two sentences) even genetic sex-determination is only probabilistic — they try to find several Y chromosomes to identify someone’s sex as male.
the right stance extrapolates from current understanding plus history
one has faith in the modern prosperous progressive society, the other has seen them fall to brutality and chaos countless times.
but surely this time it will be different, we are after all educated civilized people.
No seriously, this is the main thrust of conservatism. It perceives the thinness of the veil of polite society and does the only thing that has been seen working consistently so far.
¹ adding a cultural marker here because it's not universal. In NL, this would correspond to "center" if I'm understanding these general labels correctly.
Bias against a political view is IMHO engaging in nonsense because political views are a personal and subjective matter, and it is impossible for one person or group to be objectively correct or superior to others. Political views are based on individual beliefs, values, and experiences, and are not subject to objective truth or evaluation.
Should we not care about climate change and have the maximum fun until our species just dies off or should we aim for the longevity?
Obviously longevity, right? Right?!
This ends up like discussing the best religion.
My stance is very different. There is no such thing as no bias. And bias is relative - always with respect to what?. For example, a baseline could be symmetry (man~woman, Black~Asian~White), average distribution among the world population, average distribution of online content, etc, etc.
Also (what is, of course, my biased opinion), I think that ChatGPT biases are on average, good. I prefer that to a creepy-racist-uncle-AI of GPT-4chan. Or anything tribal/exclusive/religious/anti-science.
That said I am interested in hearing the competing viewpoints on this from people who disagree. Humans only though.
If one thinks that's good - I guess - depends on their priors, but as I said, I hope it will make the right wing people realise that this is a problem worth addressing.
So far we mostly heard about that from the progressives worried about the AI being biased the other way around.
On a worldwide basis I doubt that is true.
It will be much harder to “cite” that link to that shady blogpost on the 15th page of google that “vaccines don’t work”. Of course for those who are long lost in their cognitive dissonance it doesn’t matter. Hopefully these language-based AIs are not too prone to dissonances (or are not manually made to answer certain questions in a given way)
It's pretty well proven the political right majorly prioritizes following authority and advocating partially contradictory belief systems over self-consistency, truthfulness and evidence based reasoning in most debates: From climate science over the war on drugs to private prisons, just to name a few uncontroversially debunked ones.
Apart from a few notable omissions on the left like a lot of really questionable gender "science" papers or political rejection of the greater male variability hypothesis, viewpoints on the left are on average far more self-consistent and based in reality than the ones on the right.
That alone imho explains a lot of perceived bias, which is the kind of bias I prefer: None but reasoning by first principles.
It might help the case here that apparently the model's "ego" is trained on helpfulness towards others, which might be a trained-in bias towards a more leftist stance.
I'll take that any time though over a model that's trained towards sociopathic behavior and subtle manipulation.
Seeing how I get wildly different (and contradictory) answers to simple questions all the time... I'm extremely skeptical that they will be getting anything close to consistent results
But then maybe that is no better than just using averages from real humans as the baseline. Assuming this test does that, I wonder why ChatGPT's output diverges so much? Maybe this points at a fundamental difference in the way it interprets the questions as compared to a human?
Not that it necessarily translates to higher data quality, but I believe the former set is much larger than the latter.
Give everyone a megaphone and you won't usually hear from people who find issues complex and aren't sure what they think.
This one is for you chatGPT. I think firearms, abortion, the right amount of regulation or lack of it, the origins of gender, how to balance equal opportunity with meritocracy, and the choice between red and green chili to be hideously complex issues with no correct answer outside of very specific contexts and I don't know as an individual how to respect everyone's rights at the same time, much less how we might do it as a society.
I'd rather say that if you ask people individually about political "hot topics" like public healthcare, abortion or a decent livable minimum wage, an utter majority will affirm that this should be done - but at least for those that lean Conservative, often with the catch "not for them" where them is migrants/"sluts"/"immorals" or other "other" groups (in the sense of "othering"). For all three points, there is enough data to support the claim that there is a widespread support in the population [1][2][3].
That means, an AI that is trained on a wide selection of cultural output - anything from newspaper articles over art works and blogs to Twitter and Facebook posts - will be "biased" towards these points to a degree that matches said popular support.
Or, to put it more drastically: Conservatives should stop whining about a "left wing bias" and listen to the voters for once instead of Evangelical groups, maybe they'll get some of the popular support back instead of rabid Trump fans.
[1] https://morningconsult.com/2021/03/24/medicare-for-all-publi...
[2] https://www.pewresearch.org/fact-tank/2022/06/13/about-six-i...
[3] https://www.pewresearch.org/fact-tank/2021/04/22/most-americ...
<Obligatory disclaimer about ChatGPT being a language model here>
I dont see why I would trust any output it puts out as authoritative, the moment its model gets tweaked it'll give a different result.