Amazon S3 event notifications can be sent in response to actions taken on objects uploaded or stored in Amazon S3. The Amazon S3 notification feature enables you to receive notifications when certain events happen in your bucket.
Notification messages can be sent through either Amazon Simple Notification Service or Amazon Simple Queue Service or delivered directly to AWS Lambda to invoke AWS Lambda
Here is an example to enable Notifications through SNS
To set event notifications via SNS.
Go to services → Messaging→SNS.
In SNS dashboard,we have to create topic in SNS service and edit the Topic Policy to Publish through S3.
After creating topic,we have to update the topic policy.Next we can give email id for subscription of notifications.Once we select confirm option from email id then that email got subscribed for event notifications.
Now Go to Properties of S3 bucket and
select Events →Add notification →give event name →select Events →select SNS topic and select save option.
We can select the Event type to get notified through the Email.
When the selected action performed on S3 bucket,Subscribed users to that topic will get a notification
Amazon S3 inventory is one of the tools Amazon S3 provides to help manage your storage.Amazon S3 inventory provides a comma-separated values(CSV)flat-file out put of your objects and their corresponding meta data on a daily or weekly basis for an S3 bucket or a shared prefix.
Generally,bucket owners pay for all Amazon S3 storage and data transfer costs associated with their bucket. If you enable Requester pays on the bucket,instead of bucket owner requested user will pay.
Anonymous access to that bucket is not allowed,if we want to enable the requester pays on bucket.
We have three types of encryptions available in S3
Server-Side Encryption:All SSE performed by Amazon S3 and AWS Key Management Service (Amazon KMS) uses the 256-bit Advanced Encryption Standard(AES)
- SSE-S3 (AWS-Managed Keys)
- SSE-KMS (AWS KMS Keys)
- SSE-C (Customer-Provided Keys)
Client-Side Encryption:We can encrypt the data on the client before sending it to Amazon S3.We have to take care about the encryption and Decryption process.
- We can use SSL API end points,this ensures that all data sent to and from Amazon S3 is encrypted while in transit using the HTTPS protocol
AWS Import/Export is a service that accelerates transferring large amounts of data in to and out of AWS using physical storage appliances,by passing the Internet. AWS Import / Export supports transfers data directly on to and off of storage devices you own using the Amazon high-speed internal network.
We can ship our own device to AWS by creating a Import/Export job or we can get AWS own hardware appliances
Here is the three devices available from AWS to transit large set of data from On-premise to AWS environment.
If we are Import/Export our own Disk we can
- Import to EBS
- Import to S3
- Import to Glacier
- Export from S3
If using Snowball/snowball edge/snow mobile we can
- Import to S3
- Export to S3
Snowball is a petabyte-scale data transport solution that uses secure appliances to transfer large amounts of data into and out of the AWS cloud.
We don’t need to write any code or purchase any hardware to transfer your data.Simply create a job in the AWS Management Console and a Snowball appliance will be automatically shipped to you*. Once it arrives,attach the appliance to your local network,download and run the Snowball client to establish a connection,and then use the client to select the file directories that you want to transfer to the appliance.The client will then encrypt and transfer the files to the appliance at high speed.Once the transfer is complete and the appliance is ready to be returned,the EInk shipping label will automatically update and you can track the job status via Amazon Simple Notification Service(SNS),text messages,or directly in the Console.
You can find the AWS Snowball under Migration category:
Select the Job type (Import into S3 / Export from S3) .
Give the address to ship the snow ball device and give a name for the Job and select the S3 bucket to Import/Export the data.
By default all the data will be encrypted by KMS service.And need to create a IAM role to perform the copy operation to our S3 bucket.
We can configure the SNS topics to get notifications about the Snowball device status.
In next step,Review the screen and create the Job.Amazon will send you the snow ball device on given address.
Here is the pricing details for snow ball device:Service Feeper Job is based on the appliance capacity.We have 50 TB device and 80 TB device.First 10 days of on site usage are free*and each extra
onsite day is$15
Snow ball 50 TB:$200
Snow ball 80 TB:$250
AWS Snowball Edge is a 100 TB data transfer device with on-board storage and compute capabilities.It also have compute capability that is approximately the equivalent of an EC2 m4.4x large instance. CPU&64 GB RAM.
Snowmobile is a Exabyte-Scale Data transfer service used to move extremely large amount of data to AWS.Capacity : 100 PB
With Snowmobile,we can move100 peta bytes of data in as little as a few weeks,plus transport time. If you transfer same with 1Gbps connection,it may take more than 20 years.
We need to request the amazon with the given URL to get the snowmobile https://aws.amazon.com/contact-us/aws-sales/
AWS Direct Connect
AWS Direct Connect makes it easy to establish a dedicated network connection from your premises to AWS.Using AWS Direct Connect,you can establish private connectivity between AWS and your data center,office,or co location environment,which in many cases can reduce your network costs,increase bandwidth through put,and provide a more consistent network experience than Internet- based connections.
AWS Direct Connect lets you establish a dedicated network connection between your network and one of the AWS Direct Connect locations. Using industry standard 802.1q VLANs, this dedicated connection can be partitioned into multiple virtual interfaces.This allows you to use the same connection to access public resources such as objects stored in Amazon S3 using public IP address space,andprivateresourcessuchasAmazonEC2instancesrunningwithinanAmazonVirtual Private Cloud(VPC)using private IP space,while maintaining network separation between the public and private environments.Virtual interfaces can be reconfigured at any time to meet your changing needs.
Reduces Your Bandwidth Costs.
Consistent Network Performance
Compatible with all AWS Services
Private Connectivity to your Amazon VPC
More Information :https://fgrade.com/amazon-web-services/