Skip to content
This repository was archived by the owner on Jan 24, 2021. It is now read-only.

Automate scrape agenda items #9

Open
hungrymonkey opened this issue Apr 16, 2019 · 0 comments
Open

Automate scrape agenda items #9

hungrymonkey opened this issue Apr 16, 2019 · 0 comments

Comments

@hungrymonkey
Copy link
Contributor

	try:
		#https://selenium-python.readthedocs.io/waits.html#explicit-waits
		driver = webdriver.Chrome()
		driver.get(config.RECORD_URL+ '/' + post_url(config.AGENDA_URL, session_headers))
		wait = WebDriverWait(driver, 10)
		wait.until(EC.presence_of_element_located((By.ID, 'title_or_url')))
		driver.close()
	except Exception:
		traceback.print_exc()
		driver.close()
		config.terminate()

Sample chromedriver code for saving warc for agenda items.

@hungrymonkey hungrymonkey changed the title Scrape agenda items Automate scrape agenda items Apr 16, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant