Mastering AWS S3 Multipart Upload: Boost Your File Transfer Efficiency

AWS cloud demos منتشر شده در تاریخ 1401/08/26

5.1 هزار بار بازدید - 2 سال پیش - In this video, we'll discuss

In this video, we'll discuss how to use AWS S3 multipart upload to boost your file transfer efficiency. By using this feature, you can reduce the amount of data you need to upload by splitting your file into multiple parts.

This video will teach you how to use AWS S3 multipart upload to boost your file transfer efficiency. By splitting your file into multiple parts, you can reduce the amount of data you need to upload. We'll discuss the benefits of using this feature and how to set it up on your AWS account.

AWS Docs 🚀
✅. https://docs.aws.amazon.com/AmazonS3/...

00:00 Intro
01:00 When to use Multipart upload
01:45 multipart demo
04:04 IAM role to access S3
07:36 Connect to ec2
09:22 Split the file to 40MB each
12:00 multipart upload id
19:02 complete multipart upload

1. Launch EC2 instance with the user data below.

#!/bin/bash
sudo su
yum update -y
mkdir /home/ec2-user/multipart/
aws s3 cp [s3_bucket_url]video.mp4 /home/ec2-user/multipart/

2. SSH to ec2 and then sudo -s enter as a root user

3. Split file into chunks

split -b 40M video.mp4

aws s3api create-multipart-upload --bucket [your-bucket-name] --key [original file name]

aws s3api upload-part --bucket [your-bucket-name] --key video.mp4 --part-number 1 --body xaa --upload-id [YOUR-upload-id-here]

aws s3api upload-part --bucket [your-bucket-name] --key video.mp4 --part-number 2 --body xab --upload-id [YOUR-upload-id-here]

aws s3api upload-part --bucket [your-bucket-name] --key video.mp4 --part-number 3 --body xac --upload-id [YOUR-upload-id-here]

aws s3api upload-part --bucket [your-bucket-name] --key video.mp4 --part-number 4 --body xad --upload-id [YOUR-upload-id-here]

copy below content to list.json file

{
"Parts": [
{
"PartNumber": 1,
"ETag": "\"xxx-xx-xxx\""
},
{
"PartNumber": 2,
"ETag": "\"xxx-xx-xxx\""
},
{
"PartNumber": 3,
"ETag": "\"xxx-xx-xxx\""
},
{
"PartNumber": 4,
"ETag": "\"xxx-xx-xxx\""
}
]
}

finally finish multipart upload by following command

aws s3api complete-multipart-upload --multipart-upload file://list.json --bucket [your-bucket-name] --key video.mp4 --upload-id [YOUR-upload-id-here]

🚀 Connect me on LinkedIn: LinkedIn: gomurali

#aws #awstutorial #whatisaws #AWStutorialforbeginners #amazonwebservices #amazonwebservicestutorial #awstrainingvideos #awscertification #awstraining

2 سال پیش در تاریخ 1401/08/26 منتشر شده است.

5,101 بـار بازدید شده

... بیشتر