My Scraping Bootstrap

Scrapes "Data" and saves into SQLITE. Can also export into CSV, JSON and DBF

Use

Fork the project and use it

Install Dependencies

pip install -r requirements

To run

python scrape.py

Export data as json and csv

You will have to edit export.yaml for the correct tables which you want to export

datafreeze export.yaml

Export data as dbf

Depends on csv files created above so first created them. You will have to edit export_dbf.py for the correct csv and column names

python export_dbf.py

Author

Thejesh GN [email protected]

Fingerprint: C7D4 1911 9893 ADAF 27B0 FCAA BFFC 8DD3 C06D D6B0

Thejesh GN http://thejeshgn.com

i-at-thejeshgn-com GPG ID : 0xBFFC8DD3C06DD6B0

License

Data Scraper IMD data scrapes reservoir data and saves into SQLITE. Can also export into CSV, JSON, DBF

Copyright (C) 2014 Thejesh GN [email protected]

Data

Data is under ODC Open Database License (ODbL)

Code

Data is under GNU GENERAL PUBLIC LICENSE Version 3