Skip to content
This repository was archived by the owner on Jun 4, 2025. It is now read-only.

README.md

Latest commit

 

History

History
51 lines (35 loc) · 975 Bytes

README.md

File metadata and controls

51 lines (35 loc) · 975 Bytes
Raw

Shopify Scraper

A Node.js application for scraping product data from Shopify stores using HyperBrowser and OpenAI.

Features

  • Scrape product information from Shopify stores
  • Extract product names, prices, descriptions, and images
  • Uses HyperBrowser for reliable web scraping
  • Integrates with OpenAI for data processing

Prerequisites

  • Node.js 16 or higher
  • npm or yarn
  • HyperBrowser API key
  • OpenAI API key

Installation

  1. Clone the repository:
git clone https://github.com/your-username/shopify-scraper.git
cd shopify-scraper
  1. Install dependencies:
yarn install
  1. Set up environment variables:
cp .env.example .env
  1. Run the application:
yarn build
yarn start scrape <shopify-url>
yarn start extract <job-id>

Notes

  • The scrape command will start a crawl job and print the job ID.
  • The extract command will extract the product data from the crawl job and print the extracted data.