Data Engineering With Python

This repo contains different projects using Python language and different SQL & NoSQL databases like PostgreSQL, Apache Cassandra, SQlite3.
Prime focus of this projects are to get data from different sources and load into some database based on the nature and usecase of the project.
We will use some API to connect to the data and do transformation of the data using Python libraries and functions.
Usage of AWS services like S3, Redshift, IAM, Glue,EMR.
Transforming schemas from 3NF to star schema for simplification of query and to increase optimization.

Name		Name	Last commit message	Last commit date
Latest commit History 68 Commits
Capstone		Capstone
Data Lakes with S3 and Spark		Data Lakes with S3 and Spark
Data Modeling With Postgres		Data Modeling With Postgres
Data Modeling with Cassandra		Data Modeling with Cassandra
Data Modeling with Redshift		Data Modeling with Redshift
Data Pipelines with Airflow		Data Pipelines with Airflow
ETLusingSQLite3		ETLusingSQLite3
S3 to Redshift		S3 to Redshift
README.md		README.md

Provide feedback