Wikimedia Enterprise announces Google and Internet Archive as first customers
wikimediafoundation.org
wikimediafoundation.org
What's that pithy "law" about eventually any organization existing simply to perpetuate itself and serve the insiders who work there, rather than further its mission? Ironically what came to mind is Cunningham's Law which is the wrong one... https://meta.wikimedia.org/wiki/Cunningham%27s_Law
First, there will be those who are devoted to the goals of the organization. Examples are dedicated classroom teachers in an educational bureaucracy, many of the engineers and launch technicians and scientists at NASA, even some agricultural scientists and advisors in the former Soviet Union collective farming administration.
Secondly, there will be those dedicated to the organization itself. Examples are many of the administrators in the education system, many professors of education, many teachers union officials, much of the NASA headquarters staff, etc.
The Iron Law states that in every case the second group will gain and keep control of the organization. It will write the rules, and control promotions within the organization.
The bureaucracy is expanding to meet the needs of the expanding bureaucracy.
— Oscar Wilde
These kinds of laws, adages, quotes etc need to be short and sweet.
THE TYRANNY of STRUCTURELESSNESS by Jo Freeman:
> Contrary to what we would like to believe, there is no such thing as a structureless group. Any group of people of whatever nature that comes together for any length of time for any purpose will inevitably structure itself in some fashion. The structure may be flexible; it may vary over time; it may evenly or unevenly distribute tasks, power and resources over the members of the group. But it will be formed regardless of the abilities, personalities, or intentions of the people involved. The very fact that we are individuals, with different talents, predispositions, and backgrounds makes this inevitable. Only if we refused to relate or interact on any basis whatsoever could we approximate structurelessness -- and that is not the nature of a human group.
> This means that to strive for a structureless group is as useful, and as deceptive, as to aim at an "objective" news story, "value-free" social science, or a "free" economy. A "laissez faire" group is about as realistic as a "laissez faire" society; the idea becomes a smokescreen for the strong or the lucky to establish unquestioned hegemony over others. This hegemony can be so easily established because the idea of "structurelessness" does not prevent the formation of informal structures, only formal ones. Similarly "laissez faire" philosophy did not prevent the economically powerful from establishing control over wages, prices, and distribution of goods; it only prevented the government from doing so. Thus structurelessness becomes a way of masking power, and within the women's movement is usually most strongly advocated by those who are the most powerful (whether they are conscious of their power or not). As long as the structure of the group is informal, the rules of how decisions are made are known only to a few and awareness of power is limited to those who know the rules. Those who do not know the rules and are not chosen for initiation must remain in confusion, or suffer from paranoid delusions that something is happening of which they are not quite aware.
Striving for objective news stories is highly valuable as well as social science regarding as many perspectives on different values as possible. That generates value. Otherwise you just iterate on stagnation. The comparison the author makes is a bit random here and I believe the motivation to define it as such is that she is not content with people making different decisions. Well, nobody truly is but there are different ways to deal with that.
What I agree with is that you should look at power dynamics. Competence is as often seen as a threat by you colleagues as it is seen as a positive. Why is that? Because people feel threatened by it and start to downplay its worth. All those that are threatened do indeed quickly form a structure because of their common goals. That said, there are managers that deserve the authority as they have a talent to keep people focused on relevant issues. They are often well liked and people gladly delegate decision making. But only in the scope of their mission which should be defined just as rigidly as groups are proposed to be here. Although I argue that the latter rigidity is not as relevant.
I worked once for an organization where relative power was part of the culture. Supervisors literally sat at high desks facing the minions. In another, there was a power structure and folks directly accountable for certain things; but it was very collegial. Everyone treated each other as peers and the senior folks were more like mentors or folks with other responsibilities than bosses.
Doesn't this apply to any organization?
If you care about the goals (engineer, metal worker, etc) of an organization you AREN'T going to be promoted because of your value and need for that task. For example the lead designer for BMW M cars has great value in non-managerial role.
Those that don't care about the goals can then focus on caring about the structure, the politics, fitting in, etc. They are going to be promoted because they are modifying their behavior for that purpose.
This doesn't apply in all situations but basically business people care about business and when they are successful end up in charge.
Similarly, the test/dev for Wikidata is part of Wikimedia Cloud services (which I created). That environment is also WMF run.
Its not like its 100% exclusive, but the majority of wikidata engineers are wm-de. Operational responsibilities are a bit more shared.
Also i hardly would call it a vanity project given how popular it is.
I also dont recall wikivoyage having that much to do with WM-DE.
If you want a source, i guess you could look at https://meta.wikimedia.org/wiki/Wikimedia_Deutschland/Plan_2... but its a little light on details
https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@list...
https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@list...
MediaWiki is basically unmaintained at this point.
WMF has its issues, but "unmaintained" is over the top.
There was actually a time i would have agreed with this, and there are still under-maintained parts, but since the recreation of the platform team, i don't think its a reasonable position anymore.
[Disclaimer: i am ex-wmf contractor]
However, at the current rate it won't take long until they actually do spend 100MM+ on their own salaries.
https://upload.wikimedia.org/wikipedia/foundation/1/1e/Wikim...
Take it with a grain of salt, I guess, given the level of cynicism Hacker News seems to have about Wikimedia Foundation, and you could easily dismiss insiders defending their own organization as shills. I don't really see a way to tell from those financial statements. I'm guessing that would count as program expense and break down between salaries and professional services depending on the relative proportions to which they keep attorneys on staff versus contracting legal defense out to other firms.
I had trouble finding info on how much they spend on that, but https://meta.wikimedia.org/wiki/Legal/Legal_Fees_Assistance_... suggests the budget is carefully considered.
I would say that engineer/product/analytics salaries are part of the cost of running and updating a webpage. Then you have HR which is needed to support those employees and Legal which is especially needed given the high risk nature of Wikipedia.
Good luck keeping Wikipedia up in a useful manner without those people.
edit: Then you need Finance to help handle the costs responsibly. Then you need Fundraising to help raise the money needed to pay for all that. Then you generally want some Marketing/Branding/Communications to help with the whole talking to external humans part.
These claims are often made, but I'm not sure they check out. Plenty of much much more controversial stuff stays online / is available. But supposedly wikipedia will be destroyed without these experts.
It's a pretty good example of why you need legal teams for any sort of sustainable effort.
And they were hosting content that was blatantly illegal in many countries, while Wikipedia really isn't.
PirateBay never hosted content, and that's the problem. It's like sue yellow-pages, because they listed a drug-dealer.
And what do you mean with illegal?
Their approach to legal is to basically just get arrested, which is an interesting approach.
https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@list...
That said the list at, https://meta.m.wikimedia.org/wiki/Knowledge_Equity_Fund does seem a bit far afield, and personally i find the descriptions of what the money is to be used for too flowery and not concrete enough to be comfortable.
If you're going to make shit up, at least link to the completely open documents they use for planning, funding, and accounting, so we're basing it on the same information.
They get are trying to get financing for their organization offering a service. That is the most win-win situation that you can get.
I am all for adding an Internet-tax to finance projects like Wikipedia, but it is politically easier if it can finance itself.
There used to be an expression "don't fix what ain't broke." I feel like this old maxim is now completely ignored.
> access to Wikimedia content by reusers is currently achieved through three broad means: Scraping of web pages; data dumps; and APIs. These services are provided freely to all reusers of Wikimedia content. They are and will remain free, libre and gratis, to everyone.
> What many of the largest commercial technology organizations require in order to effectively utilize Wikimedia content goes beyond what we currently provide.
[1]: https://enterprise.wikimedia.com/docs/snapshot/ [2]: https://dumps.wikimedia.org/
Why does an organisation that has more than enough money to achieve its current and long term goals, appeal to their site visitors that they really need more money? The ads are in my opinion dishonest and emotionally manipulative, and have actively put me off supporting Wikimedia as a foundation.
But the current fundraising strategy works extremely well so I really can't see it changing it at all.
Full disclosure: Until very recently I was employed by Wikimedia as a Release Engineer. I was there for 7 years, however, I left for a new opportunity in February of this year.
I am not a fan of the direction the organization seems to be headed. During the past few years there has been rapid growth and increased corporate culture. Seems to be kind of similar to what happened with the Mozilla foundation and that really hasn't worked out well for them so I am not entirely optimistic about the future of Wikipedia and the free knowledge movement in general.
And thus diluting and losing sight of their original goals. This isn't a corporation driven inherently by eternal desire for more profit.
I applaud the their moves. The more money they have, the more likely they are to exist in perpetuity.
Needlessly limiting their revenue isn’t going to solve anything.
I think the opposite is true. Consider examples like broke lottery winners, the resource curse [1], and the long history of startups getting lots of money and then cratering, from Webvan to WeWork.
With Wikipedia in particular, I'm concerned that the more money there is, the more attractive it is to people who want to be near large streams of money for various reasons, including living large and diverting money to their own friends, pet projects, and grand visions. I'm also concerned that even if they are able to avoid those people entirely, large budgets pose other risks, including inflexibility in downturns, which I think increase the odds of a setback turning into a full collapse.
Corruption, like cancer, is statistically inevitable for organizations. The only question is whether they have the right mechanisms to detect and exercise the tumors when they're small. But the scrappier Wikipedia stays, the less we have to worry about that.
And you can be corrupt without money, true. But corrupt people tend to avoid organisations that don't have a lot of money, they all try to work where the money is. And the do-gooders that are the other group of people likely to push into an org like Wikimedia tend to be particularly defenseless against the first kind.
They’ll definitely see short term profit gains. But they’re losing sight of their original goals and risk losing their long term market.
But they've done exactly that since day 1 by refusing to show any ads.
It's a wiki with open licensed content and a bloated stack that could easily be hosted on pared down infra and staffing.
Fork it and remove the largesse.
That makes it not static.
Wikipedia gets edited a lot, and a single edit can often affect many pages (in extreme cases, millions of pages). Keeping up with content churn is where a lot of the computational resources are directed.
Now sure, this is still a lot easier than if every page view had to be rendered on demand dynamically. However a truly static site where things don't change at all is trivial compared to wikipedia to host.
Wikimedia was deleting all the video game guide content from their wikibooks project for god knows what reason.
I took it over and moved it to my existing wiki, https://strategywiki.org
[1] https://en.wikipedia.org/wiki/Template_talk:Copy_to_gaming_w...
The hard part of making a real fork of wikipedia is scale of the entire thing, and traffic level the original gets.
As long as dumps remain available for free (which as I understand they have to) the community loses nothing, and corporate actors get to contribute a bit more. I don't see things like Kiwix going away any time soon.
Part of the reason for other parts of the budget is attempting to increase editor numbers in a world where direct readership is declining (because of products like Google's knowledge graph), and improving inclusiveness, so that content will better represent the world. They are also building an endowment to be able to weather bad fundraising years.
As you can see, from 112M total expenses, internet hosting is 2.4M (or 2%), and 'other operating expenses' is 10M (or 9%). This is 11% of expenses.
This compares to 56M for salaries and 23M for awards and grants.
Where is the misinformation?
(Conflict of interest statement: I am an editor on Wikipedia for 15+ years and a member of my national Wikimedia chapter.)
Keep in mind part of the reason server costs are low is because wikimedia owns its own servers. Lots of people rent servers (e.g. AWS) where the cost of hosting will be higher because the cost of some of the sysadmin duties are covered by the AWS fee, where at wikimedia that is a salary that has to be paid.
[Coi: ex-wmf contractor but its been a while]
I believe the parent already answered your question:
> You're discussing server costs, but need to also consider hosting and data center costs, as well as employee salaries. Running Wikimedia is a pretty decent percentage of their budget.
The numbers you presented confirm this statement: 56M (salaries) + 2.4M (hosting) + 10M (other operating expenses) = 68.4M (61%)
This seems like a good idea for both the WMF and the open internet.
(Contrary to what seem to be a lot of early knee-jerk negative responses in this thread - I suspect I'm seeing a bit of "early-thread contrarian dynamic")
The discussion linked in a comment above (https://meta.m.wikimedia.org/wiki/Wikimedia_Enterprise/Essay...) also provides a pretty nice FAQ to the negative responses.
It really just represents a formalized way for commercial entities to donate to the foundation while accounting for it in their budget as a service rather than a charitable donation. It makes total sense if your business depends on Wikipedia in some way then you should contribute to it's continued existence. This is a totally sensible way to do that.
It seems for example that Google has recently resolved some long standing issues with attribution in various products(YouTube Music comes to mind).
Not quite. It sounds like they will increase bandwidth for the API.
> What many of the largest commercial technology organizations require in order to effectively utilize Wikimedia content goes beyond what we currently provide.
Google is just one example of this. Any company now has a pathway to do so.
I think this is terrible incentives, and destroys the goal of having an Encyclopedia free from interference where only truth can come through
Pretty sure google is not a big enough donor to really matter.
You’d have to look at their annual reports to get more granular info
That article is about the endowment not WMF itself. It might all be connected, but the endowment is removed enough that i think the argument that the donation gives google any control is silly.
It also says that there was a 1.1 million donation to WMF proper, based on a vote of google staff. Really not seeing the potential control there, given that it wasnt really directed by google executive. Regardless, i dont think a donation that is only ~1% of the annual budget is enough to give google any control
[1] https://techcrunch.com/2019/01/22/google-org-donates-2-milli...
[2] https://diff.wikimedia.org/2022/04/14/google-org-fellowship-...
Google can demand all they want, even if they somehow got WMF on board, WMF couldn't do anything about it.
Rather than fixing the issue with moderation and editing biases creeping into Wikipedia, they seem to be focussing on being more profligate with their money.
A win for Wikimedia beyond diversified funding is also that Google and other corporations gets an contractual obligation to follow Wikimedia licensing.
The press release isn't helping me much.
* Snapshots of a Wikimedia project - updated daily
* On-demand access to articles
* Hook into a stream of changes to articles
My somewhat concern is that the wikipedia project has kind of put a flag in the ground to say that providing free access to wikipedia is no longer part of their mission if it's automated/bulk access.
I think this is more about paying for an SLA and support agreement which is less tenable as an open free-for-all
https://www.wired.com/story/wikipedia-finally-asking-big-tec...
https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Re...
>detect vandalism or important updates at the article level.
So it gives them a better ability to control a Wikipedia page's content?
Ostensibly both want the unlimited retreivals, but this entire program seems suspicious.
As is, to me, what this is missing is an explicit explanation of why this requires being paid for and metered API with public pricing that does not require “enterprise” effort to use. I could easily see numerous people and organizations wanting real-time notifications to pages of interest to them, but few wanting this for the whole of Wikipedia.
Does anyone know more about this?
(I'm doing research in modeling text credibility for fake news detection.)