This project provides two methods to scrape Amazon product data—Name, Price, and Rating—from a search results page:
- Static Scraper using Requests + BeautifulSoup.
- Dynamic Scraper using Selenium + ChromeDriver (managed by webdriver-manager).
Both scrapers store the extracted data in CSV files for easy analysis.
- Amazon Search: Scrape listings from any Amazon search URL.
- Extracted Fields: Product Name, Price, and Rating.
- Static Scraper (Requests + BS4): Faster but may miss dynamic (JS-loaded) data.
- Dynamic Scraper (Selenium): Uses a real browser to handle JavaScript, ensuring more complete data capture.
- CSV Output: Outputs data to
amazon_static.csv
andamazon_dynamic.csv
. - Logging: Records info and errors in
scraping_log.log
.
- Python 3.7+
- pip (or
pipenv
,conda
, etc.) to install dependencies