Pipeline project

Description

Dependencies

• pandas
• sqlalchemy
• requests
• BeautifulSoup
• regex

Pipeline description:

Acquisition Module:

• 1 Acquisition function

Cleaning Module:

• 1 Cleaning function

Wrangling Module:

• 1 Merge function
• 1 Transformation function (do web-scraping)

Analysis Module:

• 2 Analysis functions (Functions have their activation argument)

Reporting Module:

• 1 (save .csv) function

Pipeline failures:

• Argument parser does not work
• Does not make API call