You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When launching ImageFromTweet Runnable, it gives the following error:
SQL: select id, text from records r WHERE NOT EXISTS (select distinct id from images i where i.id = r.id) limit 100
[DATABASE] HOST = cloudberry05.ics.uci.edu, CONNECTION COUNT = 13, MAXIMUM = 100
extracting [], results = []
error: Traceback (most recent call last):
File "/extra/yicongh10/wildfires/backend/task/image_from_tweet.py", line 25, in run
f"select id, text from records r WHERE NOT EXISTS (select distinct id from images i where i.id = r.id) limit {batch_num}")})
File "/extra/yicongh10/wildfires/backend/task/image_from_tweet.py", line 23, in <dictcomp>
self.dumper.insert({id: self.extractor.extract(text) for id, text in
File "/extra/yicongh10/wildfires/backend/data_preparation/extractor/tweet_media_extractor.py", line 28, in extract
link_type: MediaURL = URLClassifier.classify(short_url)
File "/extra/yicongh10/wildfires/venv/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 91, in new_function
return timeout_wrapper(*args, **kwargs)
File "/extra/yicongh10/wildfires/venv/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 150, in __call__
return self.value
File "/extra/yicongh10/wildfires/venv/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 173, in value
raise load
requests.exceptions.ConnectionError: None: Max retries exceeded with url: /how-to-make-a-hydrogen-conversion-kit-at-home/ (Caused by None)```
**To Reproduce**
1. start `TaskManager`
2. start a thread for `ImageFromTweet`
3. set loop time 600, other parameter are default
**Expected behavior**
Should work without error and extract image links from tweets.
**Desktop (please complete the following information):**
- OS: CentOS 7
The text was updated successfully, but these errors were encountered:
The "requests" raises exceptions when the URL is invalid.
After fixing the invalid URL problem, there are more errors:
These ones came together and showed the problem with a deprecated library: PhantomJS. I have downloaded the PhantomJS, but I am not sure where to put it.
Describe the bug
When launching
ImageFromTweet
Runnable, it gives the following error:The text was updated successfully, but these errors were encountered: