Owncloud has been forked into Nextcloud
nextcloud.com
nextcloud.com
I posted around about it, trying to figure it, ripped apart the source code to the point where I found that manually decrypting the data was resulting in gibberish. All my backups were the encrypted data, so those didn't really help either.
I still don't know what happened to this day, but I've been eternally wary of personal fileservers ever since.
[0] https://owncloud.org/blog/how-owncloud-uses-encryption-to-pr...
If I had to point the discussion of this comment, I'd point it away from what I did wrong personally (I know I f*cked up in probably more than one way).
What I learned from this is that there are no situations in which I would personally host a file server of this feature level and control over my documents. I think "all in one" (dropbox/backup/encryption/sharing/file storage) personal solutions like Owncloud try to do too much, and end up with some seriously rough edges that can turn off very large portions of their user base.
I guess the question I raise is, given my experience "can you prove to me that I can absolutely trust you with all my data"?
It also allows you to have simple redundancy, so if your NAS setup fucks up, the cloud account and external hard drive version is still there.
But the answer to that is "no". All of the time. No matter who you are asking it about. There is always the possibility of someone - no matter how much you trust them or pay them - screwing up your data. Including yourself.
Especially yourself. I trust a product with dedicated administrators who do nothing but keep people's data safe to do a much better job than i could ever do myself. I don't want that kind of responsibility when google and dropbox are willing to do it for me for a couple bucks a month.
It that vein, too, your RAID-5 system is/was a disaster waiting to happen, especially when you don't have a backup: http://www.zdnet.com/article/raidfail-dont-use-raid-5-on-sma...
The software screwed up and his backup strategy failed. The software didn't screw up because his backup strategy failed.
> "All my backups were the encrypted data, so those didn't really help either."
My guess is that the "bad encryption" simply was replicated over his "backup".
If you can't go back in time, a backup is worthless.
Ransomware are a thing, people, when will you learn?
Restoring from backup would have corrected the symptom, not the root problem: a bug.
It wouldn't have even been possible to backup the encrypted data without getting all my family members passwords too.
> Do you back up the unencrypted data though? Regardless of the viability of the raid 5 system, the raid 5 wasn't what failed. It was the encryption.
> It wouldn't have even been possible to backup the encrypted data without getting all my family members passwords too.
You could have backed up the encrypted data (+owncloud metadata) in its encrypted form. Then, when you ran into the bug that corrupted the main copy of the encrypted data, you could have restored the old backup of the encrypted data and reverted to the last working version of Owncloud to access your data.
He did have a backup. Having it also be mysteriously borked certainly violates the principle of least surprise.
That's a bug like Fukushima is an industrial accident.
The reason you need backups is exactly that you can't trust other people (or yourself) not to epically fuck things up. No matter how unambiguously totally someone else's fault it is, if your data is gone, it's gone.
1) You need incremental backups, not just a live copy, so you can rollback.
2) You need redundancy both connected/disconnected and offsite.
3) You need to test restoring.
All these requirements... how do we not expect the user to screw up? This is like crypto, except every idiot knows "don't roll your own, you'll screw that up and leave a hole".
Same problem with OwnCloud itself - it requires too much configuration, as the OP explained.
Why are we doing all this garbage manually? Where's the automatic backup solution that provides differential incremental backups so you can rollback to various points, integrates with Google/Dropbox/whatever, integrates with OwnCloud, lets you plug in an external HDD for regular disconnected backups, etc.
From what you describe in the last paragraph, that sounds like a special Owncloud client. It needs decryption keys and it needs some automated tests for verifying the backup which vary based on your use case.
I've recently been testing git-annex with the webdav special remote, and it mostly solves the integrity piece but a) if you want encryption you lose the web UI, b) even if you don't want encryption, you still lose the web UI because there are no indexes, and c) it would be too high a bar for most people to set up.
What you had was a single copy (probably a simple rsync, am I right?)... that is worth nothing in case of corruption or voluntary mischief.
Learn from your mistakes. Either use a solution that has a retention policy, or don't do backups at all.
The way apologists step up to the defense of stuff like this is appalling. The 'hard' stuff like this is supposed to be dealt with before the public release. Just because one has a backup doesn't mean that other programmers should force them to rely on it (whether they intended to or not... the point is that this kind of thing should never happen)
I am beginning to feel like we should start figuratively burning people at the stake for advertently or inadvertently destroying other peoples' data -- it is a sin about as cardinal as they get; and it seems many programmers are clearly not very scared of such an outcome. Wiping/bricking/rendering inaccessible your customers' data should be causing people to shit bricks, not go on the defensive.
Normals HATE technology bullshit like this. They just want it to work. Failures like these make the entire field look bad.
But in the end, you can't trust them to not fuck up. You have to trust that they will make a mistake, so be prepared for it. Doing backups right is just really hard.
Which, I think, was alexggordon's point. That he no longer wanted to manage the data himself because it was a hard problem, better managed by teams of professionals who have the time to do things like verify backups because they can amortize the cost of that effort over tens of thousands of customers.
As nice as that idea is, I don't think we have the tech yet to fully trust someone else with your data. You have to test it out that your backups work. Anyone who tells you otherwise is selling snake-oil at best.
Judging by the frequency of security breaches they don't hate it nearly as much as we would want.
As a Systems Librarian I did the daily (31 days worth), weekly (52 weeks worth), monthly (48 months worth) back ups with 131 tapes was a pain but it always paid off. I just had three machines and needed to go to my tapes once a day.
Insider information all the Library Management Systems are totally broken and garbage (Open Source Evergreen is doing things better). I was required to reboot my Windows Server (Purchased before I was hired) everyday. I was told this was totally acceptable. The Oracle DB was solid but the rest of the stack was total and complete garbage that cost over $125,000 and service contracts of $30,000.
Edit: Off Site aka IT Office Fireproof Case was my monthly and previous weeks. Once a week I walked them over. In the library in a fire case were the daily, and the last week. Tape was it was 2007.
Transport encryption between the various devices and the fileserver is a must, however. But going beyond that is not something I would consider to be a good thing.
The most secure (from a trust point of view, at least) method of encrypting file is obviously at rest, client-side.
Seafile uses that method, but fails on the implementation on some aspects.
"In-place" encryption versus "volume/disk" encryption both have major drawbacks and are hard to implement correctly.
In case of "in-place", the private key is a possible vulnerability (like leaving the key under the doormat).
In case of disk encryption, while it's mounted, it's worth nothing if (when) you are compromised.
That's not to say I don't appreciate the fact that ownCloud exists, but I find it much harder to use, and the fact that it's written in PHP makes me not want to dig into it to fix.
I'd join in if there were a better Pythonista to start it than myself.
Owncloud's syncing clients for mac/win/linux are descended from mirall and are pretty good. I used Owncloud server for a while then built myself a lightweight replacement in node that uses the same sync API. (webdav)
Why are we not in full control over our data with ownCloud anymore? What really changed that made the founder and top contributors leave ownCloud?
Why not just say "we're a fork of owncloud", instead they use forced marketing speak like "Nextcloud is a reboot of the most popular open source file sync and share solution", or "his previous project".
I didn't hear about this. Anyone have the scoop on it?
EDIT: NVM, found other links/discussion in this thread
Disclaimer: I am one of those folks that left ownCloud for Nextcloud.
The project SHALL NOT use topic branches for any reason.
This is a main tenet of git-flow, and it's hardly uncommon.
Jos Poortvliet, Owncloud's former community manager and now responsible for communication at Nextcloud calls it a "new start". Karlitschek and Poortvliet give as reason for the new founding "structural problems" and some "economic decisions" of the Owncloud company, that caused great dissatisfaction. They do not want to give further details. Nextcloud's business model should be focused on long-term viability and sustainability. Apparently the Owncloud company could not offer that in a satisfactory measure.
Maybe there's VC money coming in and this is a requirement to be able to be sold later... Who knows? :)
> So, the main thing we wanted is a sustainable company. A company that doesn't go away soon, that isn't forced by a bad funding situation to make stupid decisions, or to limit itself and not work with partners as much as possible.
> A similar fork? Well, if Frank and the rest of the engineers lose trust in Nextcloud, we won't have to fork as this time, we will make sure the company won't fully control trademark and code. No more CLA. Trademark in a foundation. So this is the first and last time a fork happens
>'why' is the question everybody has and I hope you understand I don't want to talk too much about that
Grow up, maybe, Jos?
This sounds to me like the usual and continuous splits inside OSS communities, but Jesus, I do miss the days when you had a detailed explanation as soon as somebody leaked the IRC logs!
It could be anything. "We feel own-cloud isn't libre enough", "We don't feel this direction is profitable", "We feel owncloud was too open", "I personally disliked one of the people there any wanted to sink the ship", etc etc (note: I am being a bit tongue in cheek here)
If its a reason I agree with, then migration makes sense, if its a reason I don't agree with, then obviously migration might not be a good idea. But no one knows what the driving motivation of nextcloud is! So its a bit more worry-causing then reassuring
I don't think it's Jos who needs to grow up. If you want to watch trainwrecks go read the celeb gossip mags.
Let's hope this brings the transparency, openness and community awareness owncloud/nextcloud always needed.
I must say does seem to be at least partially the fault of developers, since they likely had much more responsibility than upper-level managers since it was a startup founded by techies for the longest time.
So if the company manages to leave some of that baggage behind this may be quite alright.
Having worked for another German software-heavy company I must admit I understood all those complaints, because our own products were similar: Pretty good in principle, but way, WAY too little attention to details that matters to customers. With each release the number of really stupid annoying little bugs never seemed to decrease (talking about "my" ex company, I only know OC from forum comments - but OC users' complaints sound like the ones we deservedly got to hear a lot).
Well … we do have capable people who know how to properly design and develop products. We always work to make it easy to use for normal people and not only for techies. And I think the success proves that we did at least something right.
Disclaimer: I was the design lead for ownCloud and now moved on to Nextcloud.
I started using Sandstorm[0] for my personal server, and there's an app for it called Davros[1], which implements the OwnCloud protocol. It doesn't really do a good job of advertising that fact (not even mentioned in its description), but you can use the OwnCloud clients with Davros. It's been satisfying my file-syncing needs with no problems. Just be aware that it lacks versioning.
I'm excited to see what's coming for NextCloud, though.
[0] https://sandstorm.io [1] https://apps.sandstorm.io/app/8aspz4sfjnp8u89000mh2v1xrdyx97...
[0]https://tools.ietf.org/html/rfc4918
There are literally 100s and 100s of these tools... Nothing is special about OwnCloud, or Sandstorm, in this case, to support interoperability.
It's pretty obvious, IMO, that it supports WebDAV since "dav" is right there in the name.
On a related note, this is a risk which many platform companies take. If you opensource your project completely, then anyone can fork it and take it ahead if the forker is a big or well known person. I think we got really lucky with iojs and node.
Having it under a free software license / open source is exactly so that the community can step in when there is a problem with the company.
Disclaimer: I am one of the people who left ownCloud for Nextcloud. Also one of the first contributors to the project when it was still very young, and the company didn’t exist yet.
I am a long time ownCloud use. iirc, it was even announced on planetkde first.
Good luck!
You are of course very welcome to contribute again – just check https://github.com/nextcloud or join us in IRC #nextcloud or #nextcloud-dev (freenode).
Are there any decent tools out there today or is it still the same situation?
Only because a project is very transparent about security vulnerabilities does not necessarily mean it's inherently insecure. In fact, at ownCloud we found all critical vulnerabilities ourself and also run a successful bug bounty program. (for Nextcloud we are also considering one)
Check https://news.ycombinator.com/item?id=11821854 for more insights.
https://blog.hboeck.de/archives/880-Pwncloud-bad-crypto-in-t...
Only because a project is serious about actually publishing vulnerability data does not make it necessarily more insecure (or secure).
https://blog.hboeck.de/archives/880-Pwncloud-bad-crypto-in-t...
In the case of Seafile one could simply change passwords of any user etc.
But yes, crypto is hard and I agree that the way we did it at ownCloud is far away from the best way. :-)
Yes, there's FUSE, but I still prefer the way Owncloud handles my files.
Maybe NextCLoud is skunkworks: http://mashable.com/2016/05/08/silicon-valley-recap-skunkwor...
We will make sure though that this problem does not arise again since there will be a Nextcloud foundation which is in full control of the copyrights.
Disclaimer: I am the former designer of ownCloud and moved on to Nextcloud.
I too wish it wasn't written in PHP as I'd be inclined to add features, but I haven't had any of the issues mentioned in this thread.
What is the reasoning behind this new fork again?