Skip to content

This repository contains a PHP-based crawler and scraper designed to fetch and download all product data from the Buskool website (باسکول). The crawler is designed to handle large-scale data scraping efficiently and stores the collected data in JSON format.

License

Notifications You must be signed in to change notification settings

BaseMax/buskool.com-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Buskool Crawler

This repository contains a PHP-based crawler and scraper designed to fetch and download all product data from the Buskool website (باسکول). The crawler is designed to handle large-scale data scraping efficiently and stores the collected data in JSON format.

Features

  • Scrapes product data from the Buskool website.
  • Supports robust error handling.
  • Stores the extracted data in structured JSON format for easy processing.

Requirements

PHP 8.3+

Installation

Clone the repository:

git clone https://github.com/BaseMax/buskool.com-crawler.git
cd buskool.com-crawler

Usage

Run the crawler script:

php download.php
php create-products.php

The collected data will be saved in the specified directory as JSON files.

Contributing

Contributions, issues, and feature requests are welcome! Feel free to open an issue or submit a pull request.

Data Source

The data in this repository was collected from Buskool.com website. It is intended for educational, research, and development purposes only.

License

This project is licensed under the GNU General Public License v3.0. See the LICENSE file for details.

Let me know if you want any modifications or additional details!

Copyright © 2024, Max Base

About

This repository contains a PHP-based crawler and scraper designed to fetch and download all product data from the Buskool website (باسکول). The crawler is designed to handle large-scale data scraping efficiently and stores the collected data in JSON format.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages