- Python 3
- chromedriver
git clone https://github.com/Onedas/PaperCrawler.git
cd PaperCrawler
mkdir chromedriver
You can download the chromedriver here
You must download the same version of chromedriver as your Chrome. See https://www.chromium.org/developers/version-numbers for more details.
Move the chromedriver in the ../PaperCrawler/chromedriver directory like this .../PaperCrawler/chromedriver/chromedriver.exe
- For pip users, please type the command
pip install -r requirements.txt
or
pip install requests
pip install beautifulsoup4
pip install selenium
- For conda users, you can create a new Conda environment and install, using
conda env create -f environment.yml
or
conda create -n PaperCrawler python=3.6
conda activate PaperCrawler
conda install -c anaconda requests
conda install -c anaconda beautifulsoup4
conda install -c conda-forge selenium
- Default
python ECCV_crawler.py
- Optional
python ECCV_crawler.py --keyword [keyword]
- Default
python CVPR_crawler.py --years [years]
- Optional
python CVPR_crawler.py --years [years] --keyword [keyword]
- Default
python OpenReview_ICLR_crawler.py --years [years]
- Optional
python OpenReview_ICLR_crawler.py --years [years] --keyword [keyword]