Skip to content

Latest commit

 

History

History
47 lines (29 loc) · 1.3 KB

README.md

File metadata and controls

47 lines (29 loc) · 1.3 KB

Buskool Crawler

This repository contains a PHP-based crawler and scraper designed to fetch and download all product data from the Buskool website (باسکول). The crawler is designed to handle large-scale data scraping efficiently and stores the collected data in JSON format.

Features

  • Scrapes product data from the Buskool website.
  • Supports robust error handling.
  • Stores the extracted data in structured JSON format for easy processing.

Requirements

PHP 8.3+

Installation

Clone the repository:

git clone https://github.com/BaseMax/buskool.com-crawler.git
cd buskool.com-crawler

Usage

Run the crawler script:

php download.php
php create-products.php

The collected data will be saved in the specified directory as JSON files.

Contributing

Contributions, issues, and feature requests are welcome! Feel free to open an issue or submit a pull request.

Data Source

The data in this repository was collected from Buskool.com website. It is intended for educational, research, and development purposes only.

License

This project is licensed under the GNU General Public License v3.0. See the LICENSE file for details.

Let me know if you want any modifications or additional details!

Copyright © 2024, Max Base