VueScoop-It is an educational demo project designed to showcase the capabilities of the Puppeteer framework for web scraping and automation. With this tool, you can effortlessly home materials from various sites. Vueschool.io has excellent courses.
- 🌐 Web Scraping: Utilizing Puppeteer for efficient web scraping.
- 📜 Custom Logging: Implementing Winston for robust logging functionality.
- 📊 Progress Tracking: Real-time progress bars with CLI-Progress.
- 🔧 Configuration Management: Using dotenv for managing environment variables.
- ⚡ Node.js (v14 or above)
- ⚙️ npm, pnpm, or yarn
git clone https://github.com/techno-trace/vuescoop-it.git
cd vuescoop-itnpm installpnpm installyarn installnpm run startThis command will bundle the project using Webpack.
npm run goThis command executes the run/run.js script.
npm run testThis command bundles the project, clears any previous data, and runs the main script.
npm run downloadThis command bundles the project and runs the main script to download content.
- vueschool
- course downloader
- vue course downloader
- vue school
- vuescoop
- puppeteer
- web scraping
- puppeteer-testing
- vuescoop-it
- node js logger
- logger
- winston logger
- custom winston logger
- 🚀 Puppeteer
- 📡 Axios
- 📝 Winston
- 💼 Webpack
👤 Digambar Saha
📄 This project is licensed under the ISC License.
The project uses several dependencies including but not limited to:
- 🚀 Puppeteer
- 📡 Axios
- 📝 Winston
- 💼 Webpack
For a complete list, please refer to the package.json file.
- 🔄 TypeScript types for various modules
- 🔨 ts-loader
- ⚙️ webpack and webpack-cli
Feel free to contribute to this project by submitting issues or pull requests. Happy coding! 🎉