White House announces new actions to promote responsible AI innovation
whitehouse.gov
whitehouse.gov
Do you have actual quantified evidence that supports this? Also if you are going to cite a study, it should be reproducible.
And like the other commenter noted, the Institutes component seems focused on fostering new AI talent all over the country, so ergo a part of that will be making its resources accessible to many different groups of people. A claim that this initiative would be more effective in its stated goals by confining its educational resources to a single population demographic seems like it would also demand research and concrete evidence. Would that even be legal?
"Diverse" is one keyword in a whole paragraph about introducing an NSF funded program to provide educational resources for new workers to skill up on AI. America is a diverse country: Of course a program that serves all of America with that stated goal would create a diverse workforce. I'm a little confused why the top discussion on this thread has seized on that single word with such outrage.
[0]https://hbr.org/2013/12/how-diversity-can-drive-innovation
If you were taught this a decade ago you likely are familiar with the "Striving, Storming, Thriving" study which demonstrates that relation especially well.
I recall a recent hand-wringing study out of Harvard jam-packed with soothing language but showing that as teams diversify their ability to engage in shared risk-taking declines [0]
On the other hand, I still don't share the anguish over the term 'diverse' in this particular OP for the reasons I stated - if this program is designed to foster AI talent all over America, if successful it will by definition foster diverse talent.
Like if the program wasn't designed to help America build a diverse AI workforce, then it would be designed to create a demographically constrained, homogenized workforce. I wouldn't expect us to be happy about that and I wouldn't think of it as a good allocation of federal tax money.
Something not being designed to do X does not mean it is designed to do Y.
The hackles raised here over "diversity" are, as you note, likely related to demographic considerations as opposed to say geographic considerations.
The argument is usually that the goal of government programs should be to accomplish a task as effectively and efficiently as possible. In the case of AI doing so is especially important in an era of rising geopolitical multipolarity. Sacrificing this for the sake of appeasing identity interest groups is short-sighted.
As we briefly explored, arguments that demographic diversity augment this efficacy have yet to meaningfully materialize, while concrete evidence to the contrary has both in the literature and in large-scale behavioral patterns (the neighborhood trust studies come to mind). It's one of, if not THE, most contentious area of sociology and public policy right now because of the obvious implications.
IMO that's why people latch onto it and why it's getting so much attention here. It's a hot button issue of grave importance that hasn't been solved yet and discussions around it are extremely painful and frequently stifled.
In the context of this specific initiative, my view would still be: America is an inherently diverse place, so a program that seeks to develop an AI workforce across America but does not create a diverse one has not achieved “maximum effectiveness” and has not effectively served all of America.
We may be diverse, but that needn't mean every sector of every niche in every industry must be so or that it would be better if it were.
Our position in the world is relative. Our power comes from the relative delta between us and "them", whomever it is we happen to be competing with.
To forget that fundamental relation, even in service to our personal sense of morality, is solipsism.
>if it results in China or India developing more effective models faster and more cheaply
Why should we project that possibility? The most successful research centers for new AI development have been American organizations like OpenAI and Google with clearly stated diversity policies. And of course, this OP is not about private companies, it's about a public resource program. Do you have any evidence that China and India are developing more effective models faster and more cheaply and that it's because of some specific lack of attention paid to ensuring public resources are broadly accessible to all demographics?
>We may be diverse, but that needn't mean every sector of every niche in every industry must be so or that it would be better if it were.
Rather than address this whole point, I'll revisit that we are talking about a federally funded public education program. I do not think a federally funded program to develop a bigger AI workforce in America would be more successful if it did not serve all Americans, and especially not if some of the funding were diverted to gatekeeping its resources to specific demographics.
This is strictly personal opinion, but mine is: America is not China or India and that extends to the values enshrined in our founding documents and constitutional amendments. It is my view one of those values is equal opportunity for all, and it is my view we should not compromise our values for a perceived opportunity to better "compete" on an arbitrarily constrained playing field with other players we feel do not share those values. I think modern history has repeatedly proven that democratic and equitable organizations and countries prevail over those that are not and I don't see where in the lesson plan of America's history we would glean the insight that we should compromise our values now, in this case.
(China recognizes 55 ethnic minorities, and the Han majority itself speaks several mutually unintelligible languages although they kind of just ignore that.)
Harvard’s incoming freshman class is a good example of the utter failure of mandating “reflective diversity” in higher education (or above). In nominal terms, 18% of these freshman are black. They are heavily, heavily incentivized and provided substantial affordances in the admissions process, even when compared to other minority groups. And the result is actually several percentage points ABOVE “reflective diversity”! Success!
Except going by historical trends compiled by “The Journal of Blacks in Higher Education” [1], the overwhelming majority - up to 75%! - of these incoming black freshmen are wealthy scions of the elite from Africa/the Caribbean or legacy admissions.
A top-down policy supposedly designed to promote opportunities for the descendants of slaves, has not only resulted in further disenfranchisement, but has served to coat the entire situation with a pernicious sense of false righteousness that has effectively boxed out the intended beneficiaries from engaging in the public discourse with their concerns. Which, in turn, is causing actual discriminatory beliefs to arise (check out “ADOS” or “FBA” hashtags on Twitter for a taste).
And fwiw, this trend is much broader and taller than just the Ivies. I can’t find the source again at the moment, but in one recent year, an outright majority of all publicized black hires in the C-suite weren’t American born blacks. Outright homogeneity (which doesn’t exist) is hardly less “reflective” of native-born Americans than the current situation.
The saddest aspect to all this is we’d get much more actual “reflective” diversity if we pulled all the distortionary diversity money out of the upper levels of the system and put it into massively improving the communities and EARLY educational outcomes of these underrepresented groups.
Unless you believe in the absolute primacy of genetics, community/home life and early education are the ONLY reliably predictive measures for success (after controlling for wealth). Our attention should be on those things, not on shady initiatives that disincentivize Americans of all stripes for the benefit of millionaire/billionaire global elites who are far more similar to their economic peers than they are to Americans with whom they share a skin color.
[1] https://www.jbhe.com/news_views/52_harvard-blackstudents.htm...
For example, a company that employs you graduates of elite schools might be racially diverse, but if many of the employees graduated from 10 colleges and all live in San Francisco, their world views could be quite similar.
“Diversity” can also be a political signal word. Progressives love diversity for reasons unrelated to management theory.
In fact “diversity” can used to enforce rigid ideological orthodoxies.
I’m sure that’s not what organizational scientists want, but it’s often what results.
And of course, the federal government is not mandating any behavior by private businesses - it is setting the charter for a publicly funded public resource initiative. The federal government often sets in writing directives for its agencies that the average Joe would view as common sense. For example, I think it's common sense that an effectively disseminated public resource initiative to expand America's AI workforce nationwide would result in building a diverse workforce.
Diversity of ideas is superior to diversity of skin color.
Any initiative that seeks to create a "diverse workforce" by skin color consideration (even if coupled with other considerations) is inherently flawed.
Goodhart's Law tells us these initiatives boil down to a checkbox or statistic - some number that must be met. Which naturally leads to underqualified or unqualified candidates being brought on because of skin color.
Diversity of ideas is what you want. People of all skin colors come from all places, economic statuses, educational backgrounds, etc.
This is about projecting leadership and relevancy to centrists they need to win in 2024. “Look, we saved your jobs!”
It seems like a no-brainer to try and make that growing workforce come from diverse backgrounds because that will just help AI skills permeate throughout society even more, thus increasing the workforce advantage.
If one's race is in question, that is racism no matter how you ice that (very rotten) cake. Same goes for sexism.
Give equal pay and treat everyone equally, do not care for and be blind to one's race and sex. That is equality. Trying to manipulate the distributions is discrimination.
The remark about diversity comes near the end of the block, after all the discussion about inter-agency collaboration, and seems, to me, to specifically refer to the goal to "bolster America’s AI R&D infrastructure and support the development of a diverse AI workforce."
America is a very diverse country. A network of NSF institutes that is designed to expand America's AI R&D workforce will by definition create a diverse workforce if it effectively serves all Americans. I don't see why that's particularly objectionable at face.
I definitely cannot figure how to read that paragraph and project forward to this future state:
>the company's mission shifts from customer and safety focus, to pacifying employee agendas.
From what I can read, the Institutes aren't going to be directing companies to do anything.
It's not necessarily the new hires causing the issues. If a company has a successful team that isn't diverse yet also needs to be seen as diverse, it will inevitably hire into non-core areas.
The US's enemies will not put limits on their AI, it will cause their software to be better.
I'm most afraid of 'safety' making GPT stop letting you use it for medical diagnosis. The medical cartels have competed regulatory capture and AI/LLMs are a genuine threat. My wife has already used GPT to diagnose a difficult patient that was passed around by multiple physicians(and specialists) over a 2 year span. (This was January GPT3)
The local models and powerful hardware cannot arrive soon enough. I'm afraid for our patients and my personal health, we should not under estimate the greed of the medical cartels, their lobbying efforts, and the fear over 'safety' they can draw from. In my lifetime the medical cartels always win. Its urgent to have the 'cat out of the bag'.
When I was in school, the existence of YouTube and Google made many classes feel like a farce. You'd go to class, and the teacher would explain a concept so poorly that you would be forced to go home and watch a YouTube video about it. LLMs feel like an extension of this, further diminishing the relevance of in-class learning to actual education. Time will tell if this finally puts an end to the farce.
You're goddamn right. And I'm going to tell something else, if the next ChatGPT-like AI tool is chinese or russian but turns out is not trying to make quit meat, I'll take that over Captain America-GPT any day of the year.
Absolutely ridiculous statement. We know that China is requiring every chatbot to be registered with the state. The idea that they're not going to put their own limits on that stuff has absolutely no basis in reality and it's not an excuse for lax regulatory frameworks of this technology.
- Funding AI that adheres to the governments ideas of what is "ethical" and "responsible" despite massive public disagreement on how those terms manifest.
- Getting the largest tech firms in the world on board towards that goal.
- Explicitly imposing limits on what information models are allowed to share and train on if they want access to government capital and the capital of those aforementioned partners and all other businesses including capital markets that contract with the government.
so where does the funding actually come from? sure, NSF, great! but according to https://new.nsf.gov/news/nsf-announces-seven-new-national-ar..., "U.S. Department of Homeland Security’s Science and Technology Directorate" is on the list. isn't it a realistic cause for concern that these people are going to be on steering committees?
well, even setting aside DHS, IBM is also listed as a funding partner. are you saying that after IBM gives cash to the NSF, then the NSF is fair and unbiased about publishing work that might hurt IBM and help their rivals? IBM is no doubt on this list because they want to buy influence and future government contracts before they miss the boat completely, whereas google/fb/openai feel they don't need to.
i think we should follow the money, look for the conflicts of interest. it's not like you have to make research illegal to exclude players. you just gradually push them out of the loop, restrict their access to capital & research.
I mean look at it:
GPS — government technology
the internet — a government technology
ai voice assistants — Apple literally hired the head of this research straight from DARPA after DARPA had released its work to the public
touchscreens — DARPA
accelerometers — DARPA
speech recognition — more DARPA and MIT tech
One of the only non-gov't technologies core to it is microprocessors which was made by Bell Labs. But even that was only possible because of a gov't mandated monopoly on Bell Labs and legislation that forced it to invest in research. Basically what public universities areThe government is innovative. It's just not good at taking credit for it
I mean just think about it for a second. Why on earth would a private company ever invest heavily in R&D and then release that knowledge to the public so everyone (including their competitors) can benefit. All our major technological innovations have come from the public sector and that should not at all be surprising if you just think about the incentive structures
Edit: if you're interested in this topic, economist Mariana Mazzucato has a whole book on debunking public vs. private sector myths. It's quite good and draws on a lot of data and evidence to make its case and show how absurd some of our assumptions really are: https://marianamazzucato.com/books/the-entrepreneurial-state
The 2A folks would like to have a word with you...
In all seriousness - everyone assumes what they hear/read is 100% accurate and factual until it's about a topic they know something about. Then... we know the truth.
Why would some average legislator be any more qualified to regulate AI than Firearms? The answer is - they aren't.
And to bring it back around to AI, I've noticed a lot of people taking ChatGPT's responses as gospel but if you ask it about something you're knowledgeable in you can very easily catch it making stuff up and passing it off as fact.
+ Safe and Effective Systems
-> What should be expected of automated systems
--> Risk identification and mitigation
What they should really be focusing on is Hazard/Reliability engineering. "Risk" is too broad of a term for safety because it includes "economic harm" which ... well it's by decree. + Algorithmic Discrimination Protections
The only task these system perform is discrimination, and it's impossible to tell what the system can infer -- the Federal government will do anything to avoid naming the root causes of harmful inequality experienced by protected classes (and addressing that instead of holding a butter knife up to the neck of a shiny object). + Data Privacy
This is actually impossible without trust. Homomorphic encryption isn't a thing. This isn't happening. + Notice and Explanation
-> Why this principle is important
Chicago kept a secret watch list of violence-prone individuals. https://chicago.suntimes.com/2017/5/18/18386116/a-look-insid... is this important? If it was derived from OSINT, and it was being used for public safety purposes why is the federal government meddling in it -- do they have a monopoly on secrets? They shouldn't, if the public safety of Chicago is to be seen.edit: I'm not sure what the criticism is here in light of the Notice and Explanation requirement -- there was N&E at most 4y after the practice began -- and it wasn't really a gaffe, presumably such a risk assessment system is still being used. I guess the argument is that this should have been required, or made earlier?
+ Human Alternatives, Consideration, and Fallback
This is probably what we need more of at first, and then less of later -- once all these goofy flat "simple" decision models have been replaced.Here's a clear drawing of the ideal system without all the pesky words: https://ibb.co/7KrgBk4
If we extrapolate that relation, you eventually reach a point where the biggest player can collect and process the most information and produce an ever-evolving model to maintain that relation.
Better hope it's creators have your best interests at heart.
Source? My educated guess it’s somewhere between 10 to 100 times cheaper than that.
Actually:
https://www.wired.com/story/openai-ceo-sam-altman-the-age-of...
At the MIT event, Altman was asked if training GPT-4 cost $100 million; he replied, “It’s more than that.”
Granted, OP did say pre-training.
Interestingly, my own calculations lined up pretty well with this calculation, although they approached the problem from a different direction (a leak by Morgan Stanley about how many GPUs OpenAI used to train GPT-4 as well as an estimate of how long it was trained): https://colab.research.google.com/drive/1O99z9b1I5O66bT78r9S...
Sam Altman has also stated that GPT-4 cost more than $100 million to train, and replication can cost 2-4x less compute. https://www.wired.com/story/openai-ceo-sam-altman-the-age-of...
If you know of an organization that can replicate GPT-4 for $400k to $4m I would love to know so that I can invest in them.
1. We don't know what the number of parameters is, could be 175B, could be 250B, could be 400B. Ok, let's stick with 250B.
2. Training data: GPT-3 was trained on 300B tokens. It already used most of the high-quality data available on the internet, but let's say they somehow managed to find and prepare three times as much high quality data for GPT-4. This means GPT-4 was trained on about 1T tokens.
3. 5.4e+17 FLOPs/hour means 150TFlops, which is half of the BFLOAT16 max theoretical output, sounds reasonable.
4. $1/A100/hr is reasonable.
OK, so we need to divide your cost estimate by a factor of 15: Total cost to train GPT-4 comes out to be around $2.7M.
Regarding Altman's statement about "more than 100M to train GPT-4" - I'm pretty sure he was talking about the total cost to develop GPT-4, which includes a lot of experimentation and exploration, many training runs, and many other administrative costs which are not relevant to the cost of a single training run to reproduce the existing results. Just salaries alone: ~200 people worked on GPT-4 for let's say half a year, at $400k/year: 0.5 * 400k * 200 = $40M.
What makes you think "they" want you to survive?
What policy or statement have they made that affirms their interest in your life or the lives of your interest groups? Do they want to/have they already disarmed you? Do you control a means of producing your own food? Your own energy? Are they allowing people into your areas to compete with you in labor markets and for control over limited resources? Are they meaningfully protecting the future of the planet for you and your children? Are they encouraging or discouraging you from having children at all?
This is a genuine question.
(But there's also no reason to disfavor it, because welfare is largely meant to benefit non-workers like elderly and children.)
Police wants to lock you up and your boss wants to fire you using this kind of products:
https://www.aclu.org/news/privacy-technology/amazons-face-re...
And surprise surprise, it works even worse for women and minorities
https://proceedings.mlr.press/v81/buolamwini18a/buolamwini18...
LOL