Government Open Source Office deal set to provide major savings
collaboraoffice.com
collaboraoffice.com
1. Collabora Office's solutions will be available via G-Cloud Digital Marketplace. That's a big win for them as it makes it easy for government agencies to chose them.
2. There's no mention of displacing Microsoft Office, other than to the extent Collabora manages to convince individual government organizations to make the switch.
3. There's the vague claim that Collabra will work together with the Crown Commercial Service to raise awareness about ODF and their solution. Notably absent is any kind of comment from the Crown Commercial Service or any government agency. This may mean a quite big push (but if so, where are the bigwigs making statements?) or it could mean they get to be included in a newsletter or something, or anything in between...
If there had been some deal to do a massive conversion away from MS Office, you can bet that would been made very, very clear.
Unless OpenOffice/LibreOffice has gotten markedly better in the last couple of years since I got access to an MSDN subscription, it's still a second-tier product behind Office. I hate to say that, because I'm no great fan of desktop Word and Excel (I still think the 2003 editions were the best), but MS has really picked up the ball with their cloud versions integrated into Office365, which IMO, are better than Google Docs at this point.
Anecdotally, a frighteningly large part of the civil service's workflow is implemented in Excel/Word macros. If that's true, it won't matter how good LibreOffice is, migrating that to anything else is going to be the biggest pain (and cost) point.
Perhaps the next great push should not be file formats (this is largely won now IMO) but to create a standard for Office scripting languages and document automation within government?
Microsoft would have to be involved in any such effort for it to amount to anything, and I'm not sure they really have much incentive to do so - unless it is along the lines of, "here, LibreOffice, this is our document API, go implement it, and, by the way, make it compatible with all these legacy VBA scripts out in the wild".
They were then forced (by market demand) to implement ODF. I can see something similar happening in terms of document automation: only maybe this time it might be quicker given there is experience around the DOM in web browsers already, so a model is already usable.
[citation needed]
1. http://www.ausgoal.gov.au/open-formats
2. https://www.gov.uk/government/publications/hm-treasury-and-o...
3. https://www.data.gov/open-gov/
4. https://en.m.wikipedia.org/wiki/Uniform_Office_Format (China, that great bastion of transparency!)
I think that will do for now :-)
Your first link included Office Open XML as one of its office formats. The US site is about data in "machine-readable formats" being released by governement agencies. None of it seems to indicate an effort to move away from proprietary software, just interchangeable formats.
For the U.S. URL, I should have probably been more specific: try http://www.data.gov/developers/harvesting
"As part of Project Open Data most government offices are transitioning to make all of their metadata available via a standard schema contained by a data.json file. These are treated just as any other harvest source."
Actually, I should have pointed you to Project Open Data really, found here:
https://project-open-data.cio.gov/
Citations provided!
Also what happens with the archived files and documents decades later? Will they still work? Microsoft can't even achieve 100% percent compatibility between its released versions every 3 years.
There will be some transition pains, that's for sure, and in part those pains are as big as they are because the governments have adopted single-vendor proprietary products from companies for many years to begin with. It seems to me the long term upside is way bigger with open standards and open source software.
I think you meant to say country.
> There will be some transition pains, that's for sure, and in part those pains are as big as they are because the governments have adopted single-vendor proprietary products from companies for many years to begin with. It seems to me the long term upside is way bigger with open standards and open source software.
I would be curious to see how the finances work over the long haul; this year they might not save a whole bunch but what about over a five year term?
For the civil service of a country they should think over the 50 year term as well. Documents from the 1980's could still be relevant today if only as archival records.
I don’t know whether the step to libre software will save costs. Nonetheless, I’d still argue for the government to take it, for even if it were costly, taking things for the team is part of the reason of a governments existence.
What format can I export them in?
The real open format is ODF, which Microsoft is supporting somewhat but with warnings and only because they were forced to do it. That's still better than Google Docs though as GDocs can only import ODF. Which is quite ironic.
There was quite an upheaval when ODF development moved into OASIS from W3C and included quite a few patents, and OpenOffice at the time wanted to drop support for the new ODF features.
NATO calls for a recommended support for ODF, but a mandatory support Office Open XML
Office Open XML: Mandatory: Standard ECMA-376, Ed. 1: December 2006, Office Open XML File Formats.
Open Document Format:
Recommended: ISO/IEC 26300:2006, Information technology -- Open Document Format for Office Applications (OpenDocument) v1.0.
https://nhqc3s.hq.nato.int/Apps/Architecture/NISP/volume3/ap...
Same goes for many other examples especially from the governmental sector.
If MSFT wanted to bury ODF they might have managed to do so, since they've managed to get it under OASIS and tag a RAND clause into the ODF license they really don't care. EEE :)
So care to provide some references?
PS: I wasn't thinking of NATO, but of individual countries. ODF (and not OOXML) is mandatory in France, Netherlands, Norway, Portugal, Spain, Germany, Russia and it's becoming mandatory in Italy.
I find import/export of ODF is better than LibreOffice import/export of OOXML, FWIW.
Public money should be spent on open (source) software. File formats should be exchangeable and switching providers shouldn't be intentionally difficult.
I agree but only if the costs are reasonably comparable. For example if there's a commercial product that would cost 10x to replace then I don't think that's appropriate use of public money.
But if the costs are similar then OSS should always be prefered because it creates new value for other users and while a commercial entity can't necessarily capitalize on that value governments don't need to.
You can only have a license with source if you think about it ahead of time.
One of the few correct statements Ayn Rand ever made was that when the age of money ends, it will usher in the age of pull. If you support someone that advocates a technological overhaul and it doesn't pay off, then you'll be left holding the bag. Not all politics in government happens on Capitol Hill.
However it is disingenuous to discount the uncounted thousands of hours of training //per worker// in products with nearly identical look and feel (prior year's versions). This is a result of the /monopoly/ that they have had for decades.
This is also the case of every company I've seen that decided to migrate away from windows based workstations to Linux ones.
They've spent a fuckload of money on porting their tools, training, hiring linux support guys for end-user related tiers and then still nothing worked like they've planned.
Also Office is pretty much free in the enterprise world you pay pretty much absolutely nothing for it the majority of the costs go into CAL costs mainly for Exchange which you'll use Outlook to access. Even if you do not use Outlook to access exchange you'll still pay for those CAL's just that the pricing will not go through the office license but now through the Exchange one, same thing goes if you are using SharePoint for collaboration etc.
If all of a sudden you stop using office and you don't pay those 93.4$ Band-E prices per installation or w/e you'll notice your exchange License pricing to go up the next day to accommodate for the built-in CAL license in office which you do not get with 3rd party software.
This is not how the people working in the Munich municipality tell the story. [1] Although the new city major has made statements of wanting to go back to Microsoft, [2] apparently the open source system is live and well. [3]
So it seems that the whole story that "Germany switched from Windows to Linux, only to regret it years later" is a myth.
[1]http://www.techrepublic.com/article/no-munich-isnt-about-to-...
[2]http://www.techrepublic.com/blog/european-technology/mayor-o...
[3]http://www.ocsmag.com/2015/08/24/no-munich-is-not-considerin...
I've never understood why government wouldn't develop their own consultants for this sort of thing, governments often have highways agencies - the modern equivalent for communications would surely be an IT agency. In the UK we have a Department of Transport but we don't have a Department of ITC, the later seems as important a part of modern infrastructure.
There's got to be a lot of moral pressure internally - for those in control - in a company like Collabora to introduce bugs given they make their money on bug fixes. It seems government wide that purchasing the software as open source and training civil servants on the code would be highly effective in securing systems for future use?
Presumably the modifications to LibreOffice will be open source, SS 3, 3.1 here http://www.libreoffice.org/download/license/ appear to require it?
In fact, I introduced a few bugs into the VCL demo tool and Michael Meeks was quite (how should I put this?) direct in his feedback to me. Those inadvertent bugs got fixed very quickly by myself.
I can assure anyone reading - Collabora only cares about good quality work, and in fact if any work is pushed into the LO git repository that is substandard the other non-Collabora devs either a. fix it immediately or revert the changes, or b. have some stern words with the Collabora dev, or (I'd imagine) to Michael or Kendy.
P.S. Eventually all code Collabora writes gets pushed into the TDF's LO git repository. Maintaining incompatible branches for any length of time in insanity, and aside from the fact that contributing back to LO is the ethos of the Collabora Productivity team, it's better for them to do so in order to allow others to help maintain and enhance the code they write.
However, with proper external independent oversight this becomes moot, thank you for pointing out that oversight appears to be in place.
It sounds from what you say that all Collabora work is pushed to the LO git repos?
The developers have enough old bugs to fix: https://bugs.documentfoundation.org/page.cgi?id=weekly-bug-s...
Your claim is made even more absurd by the increasing focus on catching regression bugs before they hit master: https://wiki.documentfoundation.org/Development/RegressionId...
However, what you are missing is that the UK government has its own cloud agreements called G-Cloud agreements, which are part of a larger G-Cloud Framework. [1]
Microsoft has in fact been ahead of the curve on this, having already gotten accredited to IL3 levels.[2] However, Collabora are already doing deals with the UK government, and many other firms, so if they are going to implement a cloud platform then they will need to have a good story around their own accreditation so they can be part of the UK government's Digital Marketplace.
I'm very impressed with the UK Government's attempts at breaking out of vendor lockin with their new platforms. It seems to me they've made things fairly easy, and they even host their accreditation questions for G-Cloud 6 in GitHub. [3]
1. https://www.digitalmarketplace.service.gov.uk/g-cloud/framew...
2. http://www.theregister.co.uk/2013/07/01/gcloud_rules_respect...
Yet LibreOffice is said to be comparable to that version.
Sure, if you only care about quarterly costs, this is far more expensive. Luckily it seems they are not so short-sighted.
Of course it's going to be costly to switch. That's a key part of proprietary software strategy. But in the long run, the lower costs will far outweigh that initial cost. And furthermore, if many governments switch to and fund free software, it should be easy for free software to surpass proprietary software, and do so at a lower cost.
Government switching to free software has implications that go far beyond cost-savings. There are features money can't buy: proprietary software is so frequently backdoored that it's safe to assume it's all backdoored, and that security risk is huge for governments. And putting government documents in a non-proprietary file format allows accessibility, which is a key responsibility of governments serving their citizens.
The company are quoting Pentium compatible processor, 512Mb RAM and a 1024x768 screen as the minimum spec. For applications that don't need all the bells and whistles this could mean not spending money this year or next year on new machines. That could be important in the UK context.
Also, whose office suite is "better" doesn't matter. Can the software meet the task? Thats it... nobody cares if a government worker like Excel.
Exploring this stuff is automatically a cost-savings activity, because Microsoft will run around like chickens to save the business. You may end up getting significant concessions on Office just for asking the question.
Which parts of their product have you been using exactly? One can't even deselect cells in Excel, instead it will add the same cell a second time (while adding another layer of the darkening effect).
There have been other things but thankfully those haven't been stupid enough to get stuck in my head like that one.
It was not only the MS upgrade / new licensing terms & cost increases that hit some of them pretty hard, it was also the end of life for MS Windows versions (XP, servers) and that many have outsourced their IT services / departments to 3rd party providers like CapGemini, Accenture, CGI etc.
This year e.g. with the EOL of Windows 2003 server, we have heard the word "extortion" quite a few times too often with some of the agencies.
To start with, the migration of a MS Win 2003 server to e.g. MS Win 2008 R2 or 2012 can easily take 20+days.
Now multiply this with £1K p/d, plus 3rd party service uplifts, training etc.
When you look at a larger scale data-intensive agency (10k+ staff) you are talking 800-1k+ servers running MS Windows. Only a fraction of those requiring an upgrade - e.g. 70-100 - already means £Millions. The licensing cost within that are of course marginal compared to the overall TCO. What is hitting the hardest is that the 3rd party suppliers will treat the new OS versions as a "different" OS. Such migrations (MS 2003 server, like with XP to Win7) require that quite some of the legacy software running on those servers has to be upgraded / needs new service contracts / does not immediately run / has to be fully re-tested. Plus new HW of course (not included in above cost).
Similar can be said for the XP to Win7 upgrade. While there are some automation tools to test your end user application estate (larger agencies have / had 800+ "standard" applications installed) a good estimate for such a multi-year upgrade programme is in the region of £3-5M+ for 12-15k end user computers. Windows licensing costs within these figures are marginal (e.g. 5-10%) or even included within the new HW that will cost on top of this migration (est. £600 * 8-10k+ -> £6M+ computers over 3-5y). These numbers go up substantially if you are upgrading high-security environments.
These figures are for mid-size / larger UK agencies with annual IT budgets in the region of £200-300M+ - the largest UK agencies / government departments have £1B+ annual IT budgets. The situation with local government is completely different - they have to calculate with "every penny", often have only a few £M annual budgets, not having these "favourable" MS licensing terms (heard about massive increases in the last years for local governments), are already overstretched in their other budget areas - as a result of IT cost increase they will often have to cut services elsewhere. FYI, MS is much better in this arena - as for example - Oracle. There was a case documented this year when Oracle sent a UK local government a £600M annual licensing bill (increase)- Oracle, after this "shock therapy" then normally negotiates & settles for a much lower sum. Oracle claims to have an almost 80% profit margin with these kind of "licensing deals".
Hope these real-world figures help to better understand where the issues are. The main cost - IMHO - are with the way how IT is delivered & serviced (3rd party at very high cost), constant changes in licensing terms for smaller to mid-size organisations, application licensing for specific MS Win versions, end of life of core IT building blocks vs continuity and gradual upgrades. If only a fraction of these amounts go into improving (end-user) open source solutions, we will have a boost in usability & features with most of these solutions. Additionally in these cases those improvements can then be shared across all government agencies, in the UK & world-wide. In the moment each improvement or application adaptation is always charged for multiple times (within the larger gov.agency scenario often by the same 3rd party suppliers).
It would be great if someone in those government agencies would document these actual cost and Central Gov would collect this data e.g. for base-lining against e.g. Linux (there are e.g. already thousands of Linux / Unix servers running within UK government agencies).
As with the Munich example mentioned a few time in this discussion, the above numbers / ballparks would have to be used for true comparison as Munich would have had to upgrade from XP to Win7 and also face the whole server upgrade scenarios. Instead much lower MS upgrade costs have been used and most importantly - upgrades required to all the (end user) applications, forms, macros & services that would most likely also have been required within the MS Win upgrades XP -> Win7, are now being told as Linux specific cost.
This focus on office applications as the way in for Open Source software seems to me like transforming 19th Century transport by building faster horses.
It's been a decade since I've worked anywhere were anyone cared about Excel. I realize that I'm working in a "bubble" given the type of companies I tend to work with, but it does clearly illustrate that, yes, there are certainly people and companies that care about spreadsheets other than Excel.
The main point I'm making is that of the troika of office applications, only the spreadsheet still has value. I suspect I could teach everyone Markdown far faster and with better outcomes than teach Word users to move to (open office equivalent)
It's something about software literacy - you just don't need Word anymore.
Use Case 1: A basic spreadsheet for data manipulation, with no extensive macros or VBA involved. People use it for vlookups and other formulas they find useful.
Use Case 2: As a statistical analysis tool to crunch data.
Use Case 3: As a software platform, making extensive use of Visual Basic for Applications (VBA).
So here are the issues I have with your statement that Excel "is far and away the best, fastest and most robust spreadsheet out there"...
Fallacy 1: Excel is the best technical option
Excel is not necessarily the fastest spreadsheet out there for all operations. In many cases I believe it is still very fast, and beats LibreOffice under certain document loads, but this is often not by much and in fact there is ongoing work towards locating problem documents and profiling of LibreOffice code to remove bottlenecks. In fact, in LO 4.2 many performance bottlenecks were largely solved. [1]
At this point, I do think it's largely a myth that Calc is dreadfully slow. Even if it should be found that there are performance issues, however, I know that the LO community, and in particular Collabora, have a good story around their ability to use valgrind to benchmark and analyze results. As a normal part of development work, Collabora are often provided with documents that they analyse and contribute performance improvements into the core LO code base.
There are many, many errors in even basic statistical functions in most spreadsheet applications, but Microsoft Excel is particularly egregious. However, IMO the LO devs are more thorough when it comes to this [2][3]. So for use case 2 (statistical work) then I think it's not suitable (actually, for any stats work, why not just use R?)
So if Excel is not necessarily better than Calc in terms of performance, accuracy or overall robustness (you might want to look at a feature comparison here: https://wiki.documentfoundation.org/Feature_Comparison:_Libr... - quite informative I think!) then really the issue is that it's being used as a platform for VBA development.
---
Fallacy 2: Excel is the best integrated option for office application development work
So now here is the rub: this has been something causing Microsoft vendor lockin for years. Expertise in financial firms around Excel is very high, and often quite extensive custom "solutions" are based on Excel spreadsheets, but almost always via VBA.
But... Microsoft's VBA diverged from Visual Basic in VB6, and Microsoft have been struggling to know what to about it ever since. I point out that they removed support for VBA in Office 2008 for OS X, but then had to put it back in due to market demands in Office 2012, and I also note that the only update to VBA7 is to introduce actual pointers.
So basically, this will only be a competitive advantage for so long for Microsoft. As the marketplace starts to open up - and it is! - firms will be looking for solutions that either do NOT rely on Excel or VBA and that can integrate with better scripting languages, like Python.
In fact, I've been hearing that a lot of financial institutions are getting quite concerned with data silos: these are usually in Excel, haven't been audited, aren't integrated into the business' DW, are isolated and thus cause problems with transparency and decision making, and are almost NEVER documented meaning that should the maintainer leave then that spreadsheet will either be used and unmaintained, or will need to be redeveloped anyway.
So really, the key advantage Excel has is ubiquity, and really only then because of VBA, but that's a double-edged sword and eventually businesses will migrate away from it.
1. https://wiki.documentfoundation.org/ReleaseNotes/4.2#Perform...
2. http://lists.freedesktop.org/archives/libreoffice/2013-April...
3. So far as I'm aware, Excel's RNG is now using The Mersenne Twister algorithm in Excel 2010 and beyond, but that's not officially confirmed from Microsoft. It's very hard to be certain of what is being used without such a confirmation, and given that Microsoft has form in releasing a flawed RNG update already (which they never got around to fixing for years and years!) I don't know how you could consider Excel to be "more robust" than LibreOffice.
Excel is increasingly being used as Microsoft's gateway drug to an excellent self-service BI platform, Power BI. There is incredible power in providing a smooth (and approaching seamless) upgrade path from workbook with embedded queries, to a proper dimensional modelling tool (Power Pivot, AKA SSAS Tabular columnstore engine), to a proper dashboard visualization tool (Power View), to a hosted, centralized team solution (Power BI portal - mobile app batteries included), to an on prem enterprise-grade analysis engine (SSAS Tabular).
Again, this is not a refutation, but a new use case and powerful new functionality to address the concerns you raised in Fallacy 2.
The only thing is that the reason VBA is so widely used is because it's built in to every single version of Excel (except Excel 2008 on OS X), which is why it's ubiquitous. Are Power BI and PowerView things that can be used within Excel without using a server? Are there additional licensing costs?
The desktop and mobile apps are completely free and the desktop pieces can be used without a server. The web portal is cloud-hosted and freemium to anyone with a corporate email address and the mobile apps require at least the free web portal.
Feel free to email me if you're curious about more details. Gregory.Baldini at gmail dot com.
On the one side companies want to ged rid of their Excel data silos with many unverified formulas, on the other side some choose a BI platform based on Excel (data is loaded from MSSQL DB).
Additionally, the hosted solution allows Excel Services to be the presentation layer, but the real push is toward Power View.
I would suggest you do more research before spreading this disinformation. There has been significant development on this front and what you are saying is very much out of date.
Power Pivot is the Excel add-in (available for Excel 2010+) which enables dimensional modelling and >1M row analysis in Excel, and which can be transitioned to a hosted environment via SharePoint and SQL Server.
Starting with SQL Server 2012, SSAS includes Tabular mode, which allows a seamless upgrade path from an Excel Power Pivot model to an SSAS instance.
This is seamless because the same DB engine is used in both products. Power Pivot runs a private, anonymous instance of SSAS Tabular behind the Excel process, with a few features disabled (e.g. row-level security).
Power View is a high level visualization and dashboarding tool introduced for SharePoint 2010 and 2013 as a part of the SQL Server 2012 SSRS module.[1] This is the visualization tool designed to pair with Power Pivot and the Tabular model. It is also available as an add-in for Excel 2013+[2], and as part of the standalone Power BI Desktop[3] which has been available since Power BI portal's general availability in July of 2015.
I do not know what you are referring to by saying that there is a 1M row limit in practice with SP 2013 and SQL Server 2012, because this is simply not the case. If your organization is not using the features and these are pain points for you, I'd love to have further discussion with you offline - my email is gregory.baldini at gmail dot com.
[0]https://technet.microsoft.com/en-us/library/ee210682(v=sql.1...
[1]https://support.office.com/en-us/article/Power-View-in-Share...
[2]https://support.office.com/en-us/article/Power-View-Explore-...
Not challenging, I use [open|libre] a lot for writing course guides and presentations and I'm sending other people stacks of .odt/.odp stuff and they are getting interested in being able to edit the material.
For most internal communication, plain text or something like RTF at most is more than sufficient.
Trying to replace Word and Office with cheaper or open is doomed, because Office is far ahead of everything else, and everything else will be judged for not being Office.
Open source's best contribution could be a standardized simple text format.