Skip to content

Powerful proxy scraper and checker written in Go.

License

Notifications You must be signed in to change notification settings

connorscott1/XProxy

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

XProxy

Powerfull proxy scraper and checker.

Features:

  • scrape proxies from url/public proxy list.
  • Keep only proxies from one country.
  • check for proxy anonymity level.
  • Support http, socks4, socks5.
  • match custom url page.
  • scrape any webpage.
  • remove dead links.
  • ultra fast.

Speed:

  • 100K+ scrape under 5s.
  • (800 goroutines) Checked 55k proxies in 56s.

Requirements:

  • golang 1.18+
  • python 3.X+

Download:

  • download the lasted compiled version here.
  • build from src using go build .

Known issue:

  • [FIXED] Checker crash if there is invalid format into proxies file, this can happen if you are using scraper.
  • [FIXED] fixed: "bufio.Scanner: token too long", this error happen when you are loading large proxies file (100K+)

Utils:

  • If you want to split checked proxies into socks4, socks5, http files you can use parser.py file.

GitHub Repo stars GitHub top language GitHub last commit

About

Powerful proxy scraper and checker written in Go.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 93.7%
  • Python 5.1%
  • Batchfile 1.2%