Hacker News Reader

Hacker News

Comment by mewpmewp2 | Hacker News Reader

Full thread

mewpmewp2

Have they tried any other grammatically incorrect English?

View on HN

AAE is a rule-bound, internally consistent dialect.

Scholarly English grammars and dictionaries are exclusively descriptive.

https://www.linguisticsociety.org/resource/what-correct-lang...

AAVE has a perfectly coherent grammar of its own (try e.g. ‘AAVE grammar’ on Google Scholar.) It is as grammatically ‘incorrect' as Scots.

But then I wonder, how would the results be for scots for example? Or other dialects?

E.g. "Redneck English" perhaps.

I wouldn't worry about the truth of the matter; there's a US-centric cultural axe to grind here.

I am not a native english speaker, but as a teenager I definitely used weird slang - actually I still do in my private conversations - that if had to be perceived by someone would definitely seem unprofessional, etc. But I would have been perfectly capable of changing wording to type grammatically correct version of the language expected anywhere in professional situations.

Is the author implying that African Americans wouldn't be able to do that? Isn't that implication a bit racist in itself?

E.g. are they saying that given a professional context they wouldn't be able to use the Standard English?

I have seen plenty of African Americans or any race be able to speak grammatically decent standard English, wherever they are from.

The whole thing feels like trying to trick the LLMs. If they were to use slang or private conversations of anyone versus standard American English it would be perceived as lower int/lazy.

I think OPs point is, there are other perfectly coherent grammars that also may produce the same result. Were those grammars tested?

And a good follow on would be, if not, why was only one and how/why was it selected?

Still shows implicit bias and you know structural racism. It is actually looks like it could be a great measure of structural racism since the LLM is trained on everything...

But if for example my native language which is spoken by far fewer people than AAVE or Standard American English was given to LLMs, which LLMs also frequently fail at - especially anything besides GPT-4, and try to correct something that actually is correct, wouldn't it also naturally if it's forced to judge it rate it as more gibberish?

Why not do the research instead of talking hypotheticals?

I am asking questions and sharing thoughts about the research I saw above. I do not have the funds, time or motivation to do this type of research.

Just my first thought about the article is that it is doing this "think of the children" type of thing to make a case for recalling something that is really useful for many people.

Yes, also to be clear, I am not from US and neither am I a native English speaker, but to me it's obvious that in professional or business context a person must put effort in to have seemingly clear and formal English, unless they are known as this highly skilled, experienced and an eccentric character so they could potentially pull off writing in however they please.

So I would imagine that any deviation of this expected norm would yield in a result that might be perceived as more "stupid or lazy", whether it's street dialect, US southern, redneck dialect, teenager dialect, mix with other languages or otherwise.

So my point is - that it's measuring a correlation from the standard, professional, business English, rather than it being anything to do with racism.

I wonder what happens if you do this for all of the UK English dialects. Do you see a similar effect between the queen's english and yorkshire?

Reply on news.ycombinator.com