This repository contains practical exercises and examples related to AWS services, including IAM, EC2, S3, Athena, Lambda, and DMS. Each section includes code snippets and step-by-step instructions for performing common tasks in AWS.
- IAM (Identity and Access Management)
- EC2 (Elastic Compute Cloud)
- S3 (Simple Storage Service)
- Athena
- Lambda
- DMS (Database Migration Service)
Steps for creating two IAM user accounts using the root account.
- Create an IAM user and assign them to an Admin group.
- Allocate admin roles and policies to the group.
- Launch an EC2 instance of type
t2.micro
using the web UI in the AWS Console.
- After launching the EC2 instance, execute the following 5 Linux commands on AWS Linux EC2 instance:
- Example commands:
ls
,cd
,pwd
,mkdir
,touch
.
- Example commands:
- Use AWS CLI to connect to the EC2 instance.
- Instructions to connect to the EC2 instance using PuTTY.
- Create a sample S3 bucket after connecting.
- Insert a sample text file into the S3 bucket using the AWS CLI.
- Using
boto3
, create an S3 bucket programmatically.
- Steps to configure the S3 bucket for static website hosting.
- Instructions to enable versioning on the S3 bucket and view object versions.
- Steps to use AWS KMS with an S3 bucket for encryption.
- Write a PySpark code that:
- Connects to an S3 bucket.
- Performs transformations and adds a new column.
- Writes the transformed data back to S3.
- PySpark session code to read data, perform transformations, and write it back to an S3 bucket.
- Sample Spark code to connect to S3 and perform operations.
- Create sample data in S3 and use Athena to query it.
- Write a Lambda function to:
- Read data from an S3 bucket.
- Load the data into a Redshift table.
- Steps to use DMS to transfer a MySQL table to an S3 bucket.
To run the above tasks, ensure that you have:
- AWS CLI configured with the necessary permissions.
- Access to AWS Console for creating and managing resources.
- Python 3.x installed with
boto3
andPySpark
libraries for S3 and Lambda tasks.
Abdul Jawwad
This README.md
provides an overview of the tasks, including setup instructions and the required tools. You can adjust or expand on it based on your specific repository details.