Thursday 20 October 2016

Google Coldline and Multi-region cloud storage


Any Google Cloud Storage bucket can now hold data in different storage classes, and the lifecycle policy feature can automatically transition objects in-place to the appropriate colder storage class based on the age of the objects.

Storage Classes:-

This page explains the concept of storage class and the differences between storage classes. To learn how to view or change a bucket's default storage class, see Managing Buckets.

Overview of storage classes:-

In Google Cloud Storage, you create a bucket to store your data. A bucket has three properties that you specify when you create it: a globally unique name, a location where the bucket and its contents are stored, and a default storage class for objects added to the bucket.

Cloud Storage offers four storage classes: Multi-Regional Storage, Regional Storage, Nearline Storage, and Coldline Storage. All storage classes offer the same throughput, low latency (time to first byte typically tens of milliseconds), and high durability. The classes differ by their availability, minimum storage durations, and pricing for storage and access.

Note: The Multi-Regional Storage and Regional Storage terminology is distinct from multi-regional locations and regional locations; however, these storage classes must be created in a location of equivalent type. For more information about types of location, see the Bucket Locations page.
Comparison of storage classes

Use the table below to match your data storage needs with a storage class. The sections below the table describe each storage class in more detail.

Storage Class

Multi-Regional Storage

99.95% availability
Geo-redundant
Storing data that is frequently accessed ("hot" objects) around the world, such as serving website content, streaming videos, or gaming and mobile applications.
Price - $0.026


Regional Storage

99.9% availability
Lower cost per GB stored
Data stored in a narrow geographic region
Storing frequently accessed in the same region as your Google Cloud DataProc or Google Compute Engine instances that use it, such as for data analytics.
Price $0.02

Nearline Storage

99.0% availability
Very low cost per GB stored
Data retrieval costs
Higher per-operation costs
30-day minimum storage duration
Data you do not expect to access frequently (i.e., no more than once per month). Ideal for back-up and serving long-tail multimedia content.
Price $0.01


Coldline Storage

99.0% availability
Lowest cost per GB stored
Data retrieval costs
Higher per-operation costs
90-day minimum storage duration
Data you expect to access infrequently (i.e., no more than once per year). Typically this is for disaster recovery, or data that is archived and may or may not be needed at some future time.

Price $0.007


All storage classes support:

Creating buckets in locations worldwide.

The same tools and APIs to access data, including the XML API and JSON API, the command-line gsutil tool, theGoogle Cloud Platform Console, and the client libraries.

The same OAuth and granular access controls to secure your data.

Redundant storage. Cloud Storage is designed for 99.999999999% durability.

No minimal object size.

Low latency (time to first byte is typically tens of milliseconds)

The same data security through encryption at rest.

Ability to use other Google Cloud Storage features like object versioning, object notification, access logging,lifecycle management, per-object storage classes, and composite objects and parallel uploads.

Unlimited storage that can be accessed worldwide.

Paying only for what you use.

For more information about storage pricing, see Google Cloud Storage Pricing.



Bucket vs. object storage class

You can manage storage classes in your bucket and object settings.

Bucket default storage class

Each bucket has a default storage class, which you can specify when you create your bucket. Objects that you add to the bucket use this default storage class unless specified otherwise.

You can change the default storage class of your bucket later. However, this will only affect the default storage class for objects that you add to the bucket going forwards. It will not change the storage class of objects that are already in the bucket.

Note: When you create your bucket via the API and don't specify a default storage class, the bucket is assigned the Standard Storage class, which is equivalent to either Multi-Regional Storage or Regional Storage, depending on the bucket's location settings.
Object storage class
You can use the API to specify the storage class of individual objects when you add them to a bucket, or change their class later. To change the storage class of an object, see Changing Storage Classes.

Classes

Multi-Regional Storage

Multi-Regional Storage is appropriate for storing data that is frequently accessed ("hot" objects), such as serving website content, interactive workloads, or data supporting mobile and gaming applications. Multi-Regional Storage data has the most availability compared to other storage classes.

Multi-Regional Storage is geo-redundant, which means Cloud Storage stores your data redundantly in at least two regions within the multi-regional location of the bucket. This ensures maximum accessibility of your data, even in the event of large-scale disruptions, such as natural disasters.

Note that data stored as Multi-Regional Storage can only be placed in multi-regional locations, such as the United States, the European Union, or Asia.

Regional Storage

Regional Storage enables you to store data at lower cost, with the trade-off of data being stored in a specific regional location, instead of having redundancy distributed over a large geographic area.

Regional Storage is appropriate for storing data that is used by GCE instances. Doing so gives you better performance for data-intensive computations, as opposed to storing your data in a multi-regional location. In addition, storing your data as Regional Storage in this scenario can reduce network charges.

Note that data stored as Regional Storage can only be placed in regional locations, such as the US-Central1 or Asia-East1.

Nearline Storage

Google Cloud Storage Nearline is a low-cost, highly durable storage service for storing infrequently accessed data. Nearline Storage is a better choice than Multi-Regional Storage or Regional Storage in scenarios where slightly lower availability, a 30-day minimum storage duration, and costs for data access are acceptable trade-offs for lowered storage costs.

Nearline Storage is ideal for data you plan to read or modify on average once a month or less. For example, if you want to continuously add files to Cloud Storage and plan to access those files once a month for analysis, Nearline Storage is a great choice.

Nearline Storage is also appropriate for data backup, disaster recovery, and archival storage. Note, however, that for data accessed less frequently than once a year, Coldline Storage is the most cost-effective choice, as it offers the lowest storage costs.

For more information about transferring data from Amazon Glacier to Nearline Storage, see the Migrating to Google Cloud Storage From Amazon Glacier White Paper.

Coldline Storage

Google Cloud Storage Coldline is a very-low-cost, highly durable storage service for data archiving, online backup, and disaster recovery. Unlike other "cold" storage services, your data is available within milliseconds, not hours or days.

Coldline Storage is the best choice for data that you plan to access at most once a year, due to its slightly lower availability, 90-day minimum storage duration, costs for data access, and higher per-operation costs. For example:

Cold Data Storage - Infrequently accessed data, such as data stored for legal or regulatory reasons, can be stored at low cost as Coldline Storage, and be available when you need it.

Disaster recovery - In the event of a disaster recovery event, recovery time is key. Google Cloud Storage provides low latency access to data stored as Coldline Storage.

Standard Storage

Users that create a bucket without specifying a storage class, or that create Standard Storage buckets, see those buckets listed as Standard in the API. These buckets are equivalent to Multi-Regional Storage or Regional Storage, depending on their location setting, and as of Novemeber 1, 2016, are charged equivalently. Accordingly, in the Cloud Console, these buckets are listed as Multi-Regional Storage or Regional Storage.

For example, if you have a Standard Storage bucket in a multi-regional location such as US, it is equivalent to a Multi-Regional Storage bucket and continues to exist in the US location. If you have a Standard Storage bucket in a regional location such as US-EAST1, it is equivalent to a Regional Storage bucket and continues to exist in the US-EAST1location.

You can move your data from Standard Storage to other storage classes by performing a storage transfer.

Durable Reduced Availability

It is recommended that users utilize Regional Storage in favor of Durable Reduced Availability (DRA), as both storage classes have identical storage pricing, but Regional Storage offers better performance, particularly in terms of availability (DRA has a 99% availability SLA). You can move your data from DRA to other storage classes by performing a storage transfer.

Existing data stored as DRA continues to be accessible in Cloud Storage. New DRA buckets can only be created via API, not the Console.



6 comments:

  1. Reading this article is useful for everyone. Thanks for this wonderful article.
    GCP Training Online
    Online GCP Training

    ReplyDelete
  2. Your article contains very much information about Cloud Phones. Your article is very informative and useful to know more about Cloud Phones and their benefits. Thank you for sharing this article here. best cloud business phone systems

    ReplyDelete
  3. Thanks for sharing this informative article on Google Coldline and Multi-region cloud storage. If you have any requirement to Hire Google Cloud Services for your business. Please visit us

    ReplyDelete

  4. Impressive Article. Thanks for sharing.
    Azure DevOps Training Online
    Azure DevOps Online Training
    Azure DevOps Online Training in Hyderabad
    Azure DevOps Course Online
    Microsoft Azure DevOps Online Training
    Azure DevOps Training in Hyderabad
    Azure DevOps Training
    Azure DevOps Training in Ameerpet

    ReplyDelete
  5. Your blog is nice and informative also. Thanks for sharing such a nice blog cloud business phone system

    ReplyDelete