All of Google's cloud database services are now out of beta
techcrunch.com
techcrunch.com
1. Cloud Bigtable is GA [0]
2. Cloud Datastore GA [1]
3. Cloud SQL 2.0 GA [2]
4. Persistent Disk SSD now gets 25,000 IOPS [3]
5. SQL Server images available [3]
6. Custom Encryption Keys in Google Cloud Storage [3]
7. Google Nearline Storage access latency now real-time [3]
POV:
- Bigtable can reach some serious scale for Hbase-style workloads (ex: Sungard got 34m reads per second and 23m writes per second[4] ).
- Datastore serves almost 6m qps on average [1]
- Cloud SQL 2.0 compares favorably against AWS RDS and Aurora [2]
- Persistent Disk SSD compares favorably against options in the marketplace[5]
- Nearline is archival storage with real-time access characteristics
[0] (https://cloudplatform.googleblog.com/2016/08/Google-Cloud-Bi...)
[1] (https://cloudplatform.googleblog.com/2016/08/google-cloud-da...)
[2] (https://cloudplatform.googleblog.com/2016/08/Cloud-SQL-Secon...)
[3] (https://cloudplatform.googleblog.com/2016/08/why-Google-Clou...)
[4] (https://cloudplatform.googleblog.com/2016/03/financial-servi...)
[5] (https://medium.com/google-cloud/new-google-cloud-ssds-have-a...)
(Disc: work on Google Cloud)
Also any plan to allow objects in GCS bucket to automatically move to nearline after a specified time, like s3 to glacier?
Interesting how fast they drained money with such traffic..
SQL connection pools are configurable in the application. When you care about performances, you have to do benchmarking to find the optimal number of concurrent threads for the specific load.
It's noteworthy to see that google has a consistent total of queries per seconds (the average per thread drops almost linearly when adding threads), whereas RDS Aurora is exhibiting variable throughput and flat areas.
Consistency > Raw Performances
You're looking for this graph: https://cloudplatform.googleblog.com/2016/08/why-Google-Clou...
However I find the price differences for plain VPSs between these platforms and more bare bone VPS providers like OVH and dedicated server providers like Hetzner to be surprising. I understand that sometimes you get what you pay for in reliability, fast networks, etc. but still the price difference is huge.
I like having a single large memory, multiple core VPS for fast development and earlier this year I would spin a GCE instance up and down as needed. I transitioned several months ago to an always on large memory OVH VPS, much more convenient. When I need more cores and memory Hetzner has incredible pricing on dedicated servers.
Or! Through the Launcher for about $5/month to start https://console.cloud.google.com/launcher/details/bitnami-la...
I can imagine with time we see it make an appearance as a managed service, like the other databases, as well.
SQL Server also has a massive user base, especially within the large enterprises that Google is trying to get as customers.
Disclaimer: while I work on Google Cloud, I don't work on the Cloud SQL team.
I see see space taken up in my drive account by pictures but I can't find them in my Google pictures, drive, hangouts, Picasa Web albums, nowhere.
I also see things via the drive API that were shared with me long ago, but which I can't access (or remove) via the web interface.
These don't give me confidence in the overall infrastructure.
Has anyone noticed anything similarly disconcerting about their cloud services? Or are those more stable?
I'd like to migrate some work to them but I'm justifiably uneasy about what quality to expect. Are things more solid in the paid space?
I ran into a similar issue with Google Drive/Gmail. Have you checked the trash? Things stay in the trash until you delete them (and some Google services are configured to keep things in the trash for up to 30 days for automated pruning). The 'quota' page may help you pinpoint where the space takers are hiding: https://drive.google.com/drive/u/0/quota
I'll see if I can ping the people that handle BIN data to see how we handle these kinds of issues.
Disclaimer: I work in payments at Google.
This can actually be a hard problem as some banks/issuers intermix prepaid and normal credit cards BINs (and I'm sure there are other issues I don't know about)
When this happens, I have no idea which account it refers to as the emails provide no details. I just have to cross my fingers and hope nothing goes offline.
EDIT: Here's what they look like: http://i.imgur.com/XcatLQm.png AFAIK the account id denoted there as XXX-XXXXX-XXX is some behind-the-scenes account identified that isn't displayed anywhere in the UI. To hunt it down, I would have to log into a google account, then click on the link. Then repeat over and over with a dozen google accounts until I log into the one actually tied to that billing account.
Ridiculous.
One hack that may work: use + in the name part of your email (ex: name+account@example.com). Gmail at least routes them all to the "name" account. Then you can filter or label as you would like.
Looks like you're right. It's still a meaningless number in this context. It's not something I can or should have to memorise. To make it worse, an account can have multiple billing accounts.
The suggested hack should work, thanks. Hopefully Google improve the content of their email though. Hacks shouldn't be needed.
Disclaimer: I work on Google Cloud, but I'm not a filesystem expert.
tl;dr: VAT (and yes we should handle this for you, but don't today).
Disclaimer: I work on Google Cloud, but I am not a tax lawyer (nor even a lawyer).
Not seeing anything on the status page nor any outside confirmation, but many independent reports from our users, all in EU pushing to US zones.
I'm looking forward to using more Google Cloud services, but unreported (partial) outages are making me wary :(
We eventually solved the issue by passing around [1], which is not obviously displayed anywhere. I scrapped it by right clicking and <Copy Link Address> somewhere in the UI [I forgot where].
I'm bullish on Google Cloud [founder on GCE & long departed, hi there guys], so I put a solid 30 minutes of sleuthing in it, but someone less determined would have gave up a whole lot sooner.
[0] https://app.google.stackdriver.com
[1] https://app.google.stackdriver.com/account/login/<project-id...
I have been using python wrapper over the stackdriver http api. To fix a few frustrations I had with it, like big logs crashing the logger or lack of identificaiton of machine that sent the log (so you can't follow single flow of execution) I wrote the https://github.com/understandwork/stackdriver_python_logger . Then, some time later I realised that I have to use fluentd anyway.
Random, completely noncontrived example:
1. Oh, GCP wants me to use stackdriver for logging.
2. Okay, I will click stackdriver.
3. I have to reauth and am taken to another website with completely different UI than GCP.
4. I click into logs.
5. I am taken BACK to GCP, with some "stackdriver" branded logs experience.
6. Exporting, slicing, or otherwise doing anything with these logs is pretty much a nightmare.
that said the rest of GCP is pretty good, but its clear that certain parts of it have been given very little design thought, comparativelyUse datadog instead. It does all the monitoring things and it works flawlessly.
Also, try signalfx for the comparison. It's a good copycat but it lags behind in advanced integrations.
Disclaimer: I am NOT affiliated with any of these services. Just a random customer who [tried] to evaluate them all.
If it does not, we should, like other Google offerings, expect it to be cut. Google has a strict internal business case (new from around 2010 or so) - what they do now has to make money, it's no longer enough to be getting more people to use the internet, or increase use in the brand, the services has to make business sense.
Let's hope it is used and profitable, eh.
That's a fair concern. However, as of 2015 they already have between 3 and 5 % of the cloud market [0][1]. It is likely they are already profitable with the usage they have (cloud is pretty high margin). There have been very few google products that were officially taken out of beta. Google Search and Google Mail are two of those.
True, Google has a terrible reputation for dumping small dev and consumer facing products. Their cloud offerings are a completely different category. Not least of which, because they have no free tier -- only free trial. Anyone who continues to use Google Cloud products is paying for them.
[0] http://www.businessinsider.com/why-amazon-is-so-hard-to-topp...
[1] http://dazeinfo.com/2015/05/22/amazon-aws-google-cloud-micro...
Sure, Google's less-loved consumer-facing products and minor dev stuff tend to die various kinds of sad deaths.
But they don't make much money. Not compared to the Mississippi of Money that is advertising.
But let's remember: most of the money in the world isn't flowing from consumers to businesses. It sure looks that way, because many of the largest companies in the world make their money selling to consumers.
But it's an illusion. Most of the money sloshing around is in the structure of production: the vast web of inputs, transformations and services that fan in until it gets to you presenting a wad of the hard-earned.
These days the structure of production needs information to make it work. And you need some sort of Turing machine to do stuff with and to that information. Other machines to acquire, retrieve and store it. Still other machines to make all the others go. And someone clever to run all these things.
Now that it's simple to take chunks of information work and just magically send it somewhere, why the hell would you do something as capitally, criminally inefficient as buy super-rapidly depreciating atoms? Squirting electrons down a wire is fantastically better business.
The worldwide economy is measured in the many trillions. Some major, majority fraction of that economy is the structure of production. Some not-insubstantial percentage of the structure of production is in managing and transforming information.
Total addressable market is billions, heaped on billions, with a side serving of deep-fried billions.
If Google abandon GCP, the shareholders won't need to have voting control to exact vengeance. They'll bodily drag execs into the street and beat them to death with rolled-up Amazon boxes.
Graph electricity usage increase on the planet, and in 20-100 years we will need to convert the output of the sun, to sustain they present slope.
Hence why it will change to be in equilibrium with that you were replying to.
Just don't mistake the current spur with some kind of everlasting trend.