Skip to content

Find local deals at Walmart and Target

Notifications You must be signed in to change notification settings

pumaatlarge/deal_scraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Deal Scraper

NOTE - You need a proxy or you will get IP Banned. I've had success with https://myiphide.com/

Pulls local inventory from the trending deals by category and/or Brand to get a single, easy to use page with price drop detection and discount thresholds

Getting Started

  • You need python 3.5+
  • Go to docker_eck and follow the steps to getting the backend and UI running to display the deal
  • Run pip install -r requirements.txt
  • Setup your host with python cli.py setup --proxy YourProxyIPandPortGoesHere --zip_code YourZip
  • python cli.py deals --filter Lego --page 1 to start scanning for deals

Tips

  • Retrieve a new proxy for each request, it seems like you get stale results after batch submission

License

It's a public repo, do whatever.

About

Find local deals at Walmart and Target

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 96.0%
  • Shell 4.0%