This repository contains practical use cases and examples for the ScrapeGraphAI API, demonstrating how to scrape data from various websites.
Before running any use case, make sure you have:
-
Dependencies installed from the
requirements.txtfile:pip install -r requirements.txt
-
API Key configured in your
.envfile:SGAI_API_KEY=your_api_key_here
Get your API key from dashboard.scrapegraphai.com
Each use case is organized in a separate folder with its own implementation:
eBay/- eBay product scrapingYouTube/- YouTube search results scrapingLinkedin Profiles/- LinkedIn profile scraping
Each use case folder contains:
- A Python scraper script (
*-scraper.py) - A
README.mdfile with detailed usage instructions
To run any use case, navigate to the specific folder and execute:
python <use-case-name>-scraper.pycd use-cases/eBay
python ebay-scraper.pycd use-cases/YouTube
python youtube-scraper.pycd use-cases/Linkedin Profiles
python linkedin-scraper.pyFor detailed information about each use case, including customization options and advanced features, check the README.md file in each use case folder.
- Visit dashboard.scrapegraphai.com
- Sign up or log in to your account
- Navigate to the API keys section
- Copy your API key
- Add it to your
.envfile asSGAI_API_KEY