Skip to content

Latest commit

 

History

History
109 lines (90 loc) · 2.19 KB

README.md

File metadata and controls

109 lines (90 loc) · 2.19 KB
Raw

PaperCrawler

Pre-requisites

  • Python 3
  • chromedriver

How to start

1. Installation

- 1.1 Clone this repo:

git clone https://github.com/Onedas/PaperCrawler.git

- 1.2 Install chromedriver

cd PaperCrawler
mkdir chromedriver

You can download the chromedriver here

You must download the same version of chromedriver as your Chrome. See https://www.chromium.org/developers/version-numbers for more details.

Move the chromedriver in the ../PaperCrawler/chromedriver directory like this .../PaperCrawler/chromedriver/chromedriver.exe

- 1.3 Install requests, beautifulsoup4, and selenium

  • For pip users, please type the command
pip install -r requirements.txt

or

pip install requests
pip install beautifulsoup4
pip install selenium
  • For conda users, you can create a new Conda environment and install, using
conda env create -f environment.yml

or

conda create -n PaperCrawler python=3.6
conda activate PaperCrawler

conda install -c anaconda requests
conda install -c anaconda beautifulsoup4
conda install -c conda-forge selenium

2. How to Use

ECCV crawler

  • Default
python ECCV_crawler.py
  • Optional
python ECCV_crawler.py --keyword [keyword]

CVPR crawler

  • Default
python CVPR_crawler.py --years [years]
  • Optional
python CVPR_crawler.py --years [years] --keyword [keyword]

ICLR crawler

  • Default
python OpenReview_ICLR_crawler.py --years [years]
  • Optional
python OpenReview_ICLR_crawler.py --years [years] --keyword [keyword]