Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add pushshift.io search #3

Open
dmarx opened this issue Jan 30, 2018 · 1 comment
Open

Add pushshift.io search #3

dmarx opened this issue Jan 30, 2018 · 1 comment
Assignees

Comments

@dmarx
Copy link

dmarx commented Jan 30, 2018

/u/stuck_in_the_matrix has built a dataset of public comments which is searchable via an API. In addition to the current comment search methodology, you should add pulling comments from his database. It won't capture comments in private subs, but it will pull down all other comments (until he stops scraping them or supporting the API)

Example query: https://api.pushshift.io/reddit/comment/search/?author=j0be&limit=1

Limited API documentation: https://www.reddit.com/r/pushshift/comments/5gawot/pushshift_reddit_api_v20_documentation_use_this/

@j0be
Copy link
Owner

j0be commented Jan 30, 2018

Interesting. I'm guessing it still tracks deleted comments, but I can try to figure that out. Thanks for the tip.

I'll probably make this an option in the end for people to enable rather than have it make calls to an external service that isn't on reddit.

@j0be j0be self-assigned this Jan 31, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants