Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Duplicate entries in social media database #71

Open
j-h-s opened this issue Oct 20, 2017 · 1 comment
Open

Duplicate entries in social media database #71

j-h-s opened this issue Oct 20, 2017 · 1 comment
Assignees
@j-h-s
Labels
bug

Comments

@j-h-s
Copy link
Collaborator

j-h-s commented Oct 20, 2017

No description provided.

@j-h-s j-h-s self-assigned this Oct 20, 2017
j-h-s added a commit that referenced this issue Oct 20, 2017
@j-h-s
[#71] patch for duplicate database entries
beb8e2f
j-h-s added a commit that referenced this issue Oct 24, 2017
@j-h-s
Merge pull request #74 from Pirate-Parties-International/dupes
0495d9c 
[#71] patch for duplicate database entries
@j-h-s j-h-s added the bug label Dec 18, 2017
j-h-s added a commit that referenced this issue Jan 4, 2018
@j-h-s
[#71, #72] added loop checks to avoid duplicate entries in db
fa6596e
j-h-s added a commit that referenced this issue Jan 10, 2018
@j-h-s
[#71] streamlined twitter scraping a bit
3669d9c
@j-h-s
Copy link
Collaborator Author

j-h-s commented Jan 11, 2018

Hopefully this is solved for the future, we just need to remove those already in the database.
The patch works, but is very slow due to the sheer size of the database.
It might be quicker to just clear everything out and repopulate it in full.

j-h-s added a commit that referenced this issue Jan 16, 2018
@j-h-s
[#71] added party option and extra checks to make dupe patching more …
ec92a4b 
…efficient
j-h-s added a commit that referenced this issue Jan 17, 2018
@j-h-s
[#71, #72] adds resume option for duplicates patch, logging for all p…
3786236 
…atches
j-h-s added a commit that referenced this issue Feb 5, 2018
@j-h-s
[#71] adds another level of abstraction to help catch duplicate entries
43c9906
j-h-s added a commit that referenced this issue Feb 12, 2018
@j-h-s
[#71] setting up duplicates patch to run every 6 months
2f6eec5
j-h-s added a commit that referenced this issue Feb 12, 2018
@j-h-s
Merge pull request #83 from Pirate-Parties-International/dev
89e0fd6 
[#71] setting up duplicates patch to run every 6 months
j-h-s added a commit that referenced this issue Feb 19, 2018
@j-h-s
[#71] simplified patch for duplicate entries
9b726de
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@j-h-s j-h-s

Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@j-h-s