Amazon S3 Buckets

Amazon S3 Buckets

·

10 min read

What is Cloud Storage?

Cloud storage is a web service where your data can be stored, accessed, and quickly backed up by users on the internet. It is more reliable, scalable, and secure than traditional on-premises storage systems.

Cloud storage is offered in two models:

  1. Pay only for what you use

  2. Pay on a monthly basis

Now, let’s have a look at the different types of storage services offered by AWS.

Types of AWS Storage

AWS offers the following services for storage purposes:

Storage services offered by Amazon

Storage services offered by Amazon

We’ll eventually take an in-depth look at the S3 service. But before we get to that, let’s have a look at how things were before we had the option of using Amazon S3.

Before AWS S3

Organizations had a difficult time finding, storing, and managing all of your data. Not only that, running applications, delivering content to customers, hosting high traffic websites, or backing up emails and other files required a lot of storage. Maintaining the organization’s repository was also expensive and time-consuming for several reasons. Challenges included the following:

  1. Having to purchase hardware and software components

  2. Requiring a team of experts for maintenance

  3. A lack of scalability based on your requirements

  4. Data security requirements

These are the issues AWS S3 would eventually solve. So, what exactly is AWS S3?

Your One-Stop Shop for Cloud Expertise

Caltech Cloud Computing BootcampEXPLORE PROGRAM

Your One-Stop Shop for Cloud Expertise

What is AWS S3?

Amazon S3 (Simple Storage Service) provides object storage, which is built for storing and recovering any amount of information or data from anywhere over the internet. It provides this storage through a web services interface. While designed for developers for easier web-scale computing, it provides 99.999999999 percent durability and 99.99 percent availability of objects. It can also store computer files up to 5 terabytes in size.

AWS S3 Benefits

Some of the benefits of AWS S3 are:

  • Durability: S3 provides 99.999999999 percent durability.

  • Low cost: S3 lets you store data in a range of “storage classes.” These classes are based on the frequency and immediacy you require in accessing files.

  • Scalability: S3 charges you only for what resources you actually use, and there are no hidden fees or overage charges. You can scale your storage resources to easily meet your organization’s ever-changing demands.

  • Availability: S3 offers 99.99 percent availability of objects

  • Security: S3 offers an impressive range of access management tools and encryption features that provide top-notch security.

  • Flexibility: S3 is ideal for a wide range of uses like data storage, data backup, software delivery, data archiving, disaster recovery, website hosting, mobile applications, IoT devices, and much more.

  • Simple data transfer: You don’t have to be an IT genius to execute data transfers on S3. The service revolves around simplicity and ease of use.

These are compelling reasons to sign up for S3. Now, let’s move on and have a look at some of the major components of the AWS S3 storage service.

AWS Buckets and Objects

An object consists of data, key (assigned name), and metadata. A bucket is used to store objects. When data is added to a bucket, Amazon S3 creates a unique version ID and allocates it to the object.

Example of an object, bucket, and link address

Example of an object, bucket, and link address

AWS Login

Logging into AWS

AWS Login - Selecting S3 from Service offerings

Selecting S3 from Service offerings

AWS Login - Amazon S3 bucket list

Amazon S3 bucket list (usually empty for first-time users); create a bucket by clicking on the “Create bucket” button

AWS Login - Create a bucket by setting up name, region and other options

Create a bucket by setting up name, region, and other options; finish off the process by pressing the “Create” button

AWS Login - Select the created bucket

Select the created bucket

AWS Login - Click on upload to select a file

Click on upload to select a file to be added to the bucket

AWS Login - Select a file to be added

Select a file to be added

AWS Login - The file is now uploaded into the bucket

The file is now uploaded into the bucket

Let’s now have a look at how Amazon S3 works.

Boost Your Cloud Skills. Land an Architect Role

Cloud Architect Master's ProgramEXPLORE PROGRAM

Boost Your Cloud Skills. Land an Architect Role

How Does Amazon S3 work?

Like we saw in the example above, first off, a user creates a bucket. When this bucket is created, the user will specify the region in which the bucket is deployed. Later, when files are uploaded to the bucket, the user will determine the type of S3 storage class to be used for those specific objects. After this, users can define features to the bucket, such as bucket policy, lifecycle policies, versioning control, etc.

Now, let’s talk about the different storage classes offered by Amazon S3.

Learn about the AWS architectural principles and services like IAM, VPC, EC2, EBS and more with the AWS Solutions Architect Course. Register today.

What is AWS S3: Amazon S3 Storage Classes

Let’s have a look at the different storage classes using the example of a school:

  1. Amazon S3 Standard for frequent data access: Suitable for a use case where the latency should below. Example: Frequently accessed data will be the data of students’ attendance, which should be retrieved quickly.

  2. Amazon S3 Standard for infrequent data access: Can be used where the data is long-lived and less frequently accessed. Example: Students’ academic records will not be needed daily, but if they have any requirement, their details should be retrieved quickly.

  3. Amazon Glacier: Can be used where the data has to be archived, and high performance is not required. Example: Ex-student’s old record (like admission fee) will not be needed daily, and even if it is necessary, low latency is not required.

  4. One Zone-IA Storage Class: It can be used where the data is infrequently accessed and stored in a single region. Example: Student’s report card is not used daily and stored in a single availability region (i.e., school).

  5. Amazon S3 Standard Reduced Redundancy storage: Suitable for a use case where the data is non-critical and reproduced quickly. Example: Books in the library are non-critical data and can be replaced if lost.

Storage Class

A comparison of all storage classes

Technical comparison between classes

Technical comparison between classes

Let’s now have a look at the different features offered by S3.

Free Course: Introduction to Cloud Computing

Learn the Fundamentals of Cloud ComputingENROLL NOW

Free Course: Introduction to Cloud Computing

AWS S3 Features

Lifecycle Management

In lifecycle management, Amazon S3 applies a set of rules that define the action to a group of objects. You can manage and store objects in a cost-effective manner. There are two types of actions:

1. Transition Action

With this action, you can choose to move objects to another storage class. With this, you can configure S3 to move your data between various storage classes on a defined schedule. Assume you’ve got some data stored in the S3 standard class. If this data is not used frequently for 30 days, it would be moved to the S3 infrequent access class. And after 60 days, it is moved to Glacier. This helps you to migrate your data to lower-cost storage as it ages automatically.

2. Expiration Actions

Here, S3 removes all objects within the bucket when a specified date or time period in the object’s lifetime is reached.

An example of how lifecycle management works:

S3 Features

From within your bucket select management

S3 Features - Select Lifecycle and then click on the Add lifecycle rule

Select “Lifecycle” and then click on the “Add lifecycle rule.”

S3 Features - Add a rule name and scope

Add a rule name and scope

S3 Features - Configure transaction options

Configure transaction options

S3 Features - Set up expiration details

Set up expiration details

Bucket Policy

Bucket policy is an IAM policy where you can allow or deny permission to your Amazon S3 resources. With bucket policy, you also define security rules that apply to more than one file within a bucket. For example: If you do not want a user to access the “Simplilearn” bucket, then with the help of JSON script, you can set permissions. As a result, a user would be denied access to the bucket.

S3 Features

Use an online tool to generate a policy. Select the type of policy as an S3 bucket policy. Select the appropriate effect. In this case, denying access.

S3 Features - Find the ARN of the bucket

Find the ARN of the bucket

S3 Features - set up a JSON script to deny access

Set up additional conditions and set up a JSON script to deny access to a particular user. In this case, “simplilearn.”

S3 Features - set up a bucket policy under Permissions

Go back to the bucket and set up a bucket policy under “Permissions.” Then click on “Save.”

Become a Certified Expert in AWS, Azure and GCP

Caltech Cloud Computing BootcampEXPLORE PROGRAM

Become a Certified Expert in AWS, Azure and GCP

Data Protection

Amazon S3 provides IT teams with a highly durable, protected, and scalable infrastructure designed for object storage.

Amazon S3 protects your data using two methods:

  1. Data encryption

  2. Versioning

  3. Cross-region Replication

  4. Transfer Acceleration

S3 Features - turn on Versioning

Go to your bucket, select properties, and turn on “Versioning.”

S3 Features - Upload an object

Upload an object

S3 Features - Upload another file of the same name

Upload another file of the same name

S3 Features - Select the file and alternate between its current and older versions

Select the file and alternate between its current and older versions

1. Data Encryption

This refers to the protection of data while it’s being transmitted and at rest. It can happen in two ways, client-side encryption (data encryption at rest) and server-side encryption (data encryption in motion).

2. Versioning

It is utilized to preserve, recover, and restore an early version of every object you store in your AWS S3 bucket. Unintentional erases or overwriting of objects can easily be managed with versioning. For example, in a bucket, it is possible to have objects with the same key name but different version IDs.

3. Cross-region Replication

Cross-region replication provides automatic copying of every object uploaded to your buckets (source and destination bucket) in different AWS regions. Versioning needs to be turned on to enable CRR.

Create a new bucket in a different region

Create a new bucket in a different region

go to Management and then replication

Select uploaded file, go to “Management” and then replication.

Here, click on “Add Rule.”

Select the source, destination and IAM rule

Select the source, destination, and IAM rule

4. Transfer Acceleration

This enables fast, easy, and secure transfers of files over long distances between your client and S3 bucket. The edge locations around the world provided by Amazon CloudFront are taken advantage of by transfer acceleration. It works by carrying data over an optimized network bridge that keeps running between the AWS Edge Location (closest region to your clients) and your Amazon S3 bucket.

Go to properties and select transfer acceleration to enable it

Go to properties and select transfer acceleration to enable it

Amazon S3 Console

The Amazon S3 Console, found inside AWS Management, helps you to easily manage objects and buckets. The console gives users an intuitive, browser-based interface that lets you easily interact with AWS services.

You use the S3 console to create, configure, and manage buckets, and to upload, download, and manage objects. The console also lets you organize storage using a logical hierarchy.

Competitor Services

AWS S3 isn’t the only object software storage service available. These are the primary competitive choices you can choose as alternatives:

  • Alibaba Cloud Object Storage Service (OSS)

  • Azure Blob storage

  • Cloudian

  • DigitalOcean Spaces

  • Google Cloud Storage

  • IBM Cloud Object Storage

  • Oracle Cloud Infrastructure Object Storage

  • Zadara Storage

Why Should I Consider Using Amazon S3?

Now that we’ve answered the question “What is AWS S3?” let’s dig into why you should consider using it. There are two big reasons why you should use Amazon S3, and they’re points we’ve covered before but bear calling further attention to:

  • S3 offers 99.999999999% (11 9s) data durability. That means, if you stored 10,000,000 objects in Amazon S3, you would only lose a single object every 10,000 years. That is durable!

  • S3 will automatically create and store copies of every uploaded object across many systems. This protects your data against errors, failures, and threats while guaranteeing you complete data availability when you need it.

I am Sunil kumar, Please do follow me here and support #devOps #trainwithshubham #github #devopscommunity #devops #cloud #devoparticles #trainwithshubham

sunil kumar

Shubham Londhe

Connect with me over linkedin : linkedin.com/in/sunilkumar2807