Is Bigtable a Zonal or a regional service? I read that Bigtable is a Zonal service and then i see that Regional Replication for Bigtable is in GA now.
And what is the difference between Bigtable and Datastore, i saw that Bigtable is kind of IaaS and Datastore is fully managed, can anyone please lay out the differences between these two, it's a bit confusing. Thanks
As you pointed out Cloud Bigtable supports Regional Replication.
This makes the data distribution in BigTable regional.
Regarding your question about the differences of Cloud Bigtable and Datastore I found a very nice Stackoverflow post addressing the differences between the two and I believe that will address your question.
Related
Does anyone know how the following services take their time references from. In other words: with what source do they sync their time reference?
Firebase
MongoDB Atlas
Found out that AWS services sync their time with a service called Amazon Time Sync.
Amazon Time Sync is used by EC2 instances and other AWS services. It
uses a fleet of redundant satellite-connected and atomic clocks in
each Region to deliver time derived from these highly accurate
reference clocks. This service is provided at no additional charge.
Likewise I need information about Firebase and MongoDB Atlas specifically. Any help/source is appreciated.
What I found by myself.
AWS Services - AWS services sync time with Amazon Time Sync. It uses a fleet of redundant satellite-connected and atomic clocks in each Region to deliver time derived from these highly accurate reference clocks.
Google Services - Google services including Firebase use Google Public NTP. This is a free, global time service that you can use to synchronize to Google's atomic clocks.
MongoDB Atlas - MongoDB Atlas has been enhanced by a move to a global logical clock. Implemented as a hybrid logical clock and protected by encryption.
Since all the services use highly accurate time services, we can assume that they represent the exact time so that time is synchronized across all the services in one application.
References
https://aws.amazon.com/about-aw
https://developers.google.com/time/faq
https://www.mongodb.com/blog/post/transactions-background-part-4-the-global-logical-clock
I found this article regarding data transfer prices for certain services, but not including DynamoDB.
What is the rate for DynamoDB data transfer out?
It is the same price as EC2, but this is only for when you are accessing DynamoDB from outside of that AWS region. If you want to verify, use the AWS calculator and do 1 GB/day of EC2 out data transfer and so the same for DynamoDB. It should be $1.40 for each.
Three examples where you might run into this charge are:
Apps in us-west-2 accessing a DynamoDB table in us-east-1.
Apps accessing a DynamoDB table over a VPN or dedicated link.
Accessing a DynamoDB table over the Internet. For obvious security purposes, this is likely not a good idea. If you are going to do it, really lock it down with IAM permissions!!!
as a follow up to the twitter conversation here https://twitter.com/johannwalder/status/854791427871694848 is it possible to use our own encryption keys for the DocumentDB encryption at rest?
I have found the following answer "We are working on providing capabilities for customers to bring their own encryption keys." about storage service here https://learn.microsoft.com/en-us/azure/storage/storage-service-encryption but not sure if the same applies to DocumentDB as well.
Thank you!
Best regards,
Johann
Johann - DocumentDB is delivering "Encryption at Rest with Service Managed Keys." As PaaS service we have done all the heavy lifting of managing keys and keeping them secure. We have also worked with auditors to ensure we are PCI compliant as are customers using our service. I mention this because many customers ask for "Customer Managed Keys" as a proxy for meeting compliance requirements like PCI.
Happy to discuss any of the topics around Encryption At Rest (E#R) more in the coming ~week I'll be posting some detailed documentation. Until then ... happy computing and thanks for using Azure DocumentDB.
Anthony F. Voellm [Microsoft Developer]
For context I'm the lead developer delivering the Encryption at Rest feature for DocumentDB.
We are defining our privacy policy and customers (specially in the EU) are concerned where their data is located.
Is this still the right answer or did anything change since 2014?
http://grokbase.com/t/gg/firebase-talk/14axy4z42p/firebase-where-is-my-data-stored
At the Google DevFest in Amsterdam, I heard from Frank van Puffelen who presented Firebase to us that at that time (10/10/2015) they had a datacentre in the US and were planning to open one in Europe.
I'd like to give you more details but that's all I know.
I'm also hoping they will open a datacentre in the EU, since there are fresh laws about where our data collected from EU citizens can be stored and that the Safe Harbour legislation will become irrelevant from what I understand (correct me if I'm wrong).
According to the official FAQ, there are certain services that are US-Only.
For example, these are US-Only:
Firebase Realtime Database
Cloud Firestore for Firebase
The rest of the services are claimed Global, and can be hosted in any Google data center, or even a data center run by a selected external party. E.g.:
Cloud Storage for Firebase
Cloud Functions for Firebase
The FAQ also mentions, that Firestore will soon become available Globally:
Note: Though currently US-only, Cloud Firestore will soon be available at all Google Cloud Platform locations.
According to the Google guide Set a project location, you can either choose for a multi-regional location or a regional location. Multi-regional locations offer better replication over multiple regions and better write latency, but are only available in the US (as of writing). Regional locations keep your data within the region, but that means that if that region experiences e.g. a power outage, your service will become unavailable. However, for regional locations, a data center in Frankfurt, Germany is available (again, as of writing).
Side-Note: Cloud Firestore and Cloud Storage will be within the specified region, but Cloud Functions will always be in us-central1 (as of writing).
I see some offerings in that section of compute cloud. We have been actively creating PostgreSQL failover instances for last couple of years. How can we contribute those to Google compute cloud so that other users can help from it?
I believe your best bet is to contact someone in the sales team . Another way is to subscribe to Google Groups (ex. gce-discussion) and add any information or contribution you deem to be noteworthy for the community.