-
Notifications
You must be signed in to change notification settings - Fork 5
changes
The project arose out of a fork from the original UFS-scraper by user Harismuneer. The fork was created in order to mitigate rate limiting restrictions imposed by The Book of Face that prevented the original script from running successfully. Since then, this project has been maintained and updated to implement those mitigation strategies from time to time, but now the original source code base has been removed from github and is now only available with a significant price tag attached to it. Having learned much about the technologies that allow this script to run and preferences chosen to simply the structure of this repository, we have little need for the original source code anyways, and will attempt to maintain it to the best of our available resources.
Traditionally UFS scraped all types of data from profiles, it is assumed much of this data was superflous and only consumed time and resources. Most of the time when profiles are desired to be scraped, it is the media that is desired and not all that other personal info the user already knows and is aware of.
Both selenium and the book of face have made significant changes to the resources this script uses to perform it's functions. The book of face has completely changed all onpage references that this script uses and has discontinued several features. All page references will have to be rediscovered and corrected. Selenium has also changed itself and several functions within the script will need to be altered in order for this script to run.
It appears that at the moment, the significant changes to the structure of the book of face website have been made, and the script has been tweaked to successfully scrape all profiles listed in the input.txt along with all the profiles of the friends of the profiles in the input.txt filtered by gender. This represents a significant milestone in the development of the project, meaning the project has acquirred both maturity and stability. Several complementary scripts have been created providing more functionality for the project.
-
One allows the user to simply backup the
input.txtand then automatically will create a new list from the friends of a desired user that has already been scraped. This script provides another level of depth available for the user to scrape, and can help to unveil unseen social dynamics of the target users. -
Another script which is currently still in the development stage will allow the user to discover instagram, vsco, and twitter accounts associated with targeted group of users and then will procede to scrape all photos from those accounts as well. It might be best to fork this to a different project, as it entails a new functionality that was not intended in the scope of the original project.
Minor improvements will continue to be made as the script is ran and results are collected.
The work and information provided in this repository and wiki are purely for educational purposes only (cough, cough), Facebook strictly forbids scraping and can result in being banned from the site by an utter tight wad. We are not responsible for any damages or legal actions that may or may not arise. You have been advised. Have fun!