PyWordlist-Toolset

☑️ Bandit verified  |  ☑️ Synk verified  |  ☑️ Pylint verified 9.97/10

Purpose

PyWordlist-Toolset features numerous modes for wordlist generation.

bin - Parses words from binary file
text - Parses words from text file
pdf - Parses words from PDF file
sanitize - Sanitizes existing wordlist, removing punctuation, quotation marks, and excess whitespace
scrape - Takes website end points as input wordlists, scrapes webpage data to format wordlist
gobuster - Takes gobuster output as input, scrapes the endpoints to format wordlist

Note: scraping modes support IPv4 & IPv6 addressing or domain names.

Aside from the sanitizer, all scripts generate the wordlist in append mode.
This allows the scripts to be executed in various combinations while still resulting in a single wordlist.

License

The program is licensed under GNU Public License v3.0

Contributions or Issues

CONTRIBUTING

Prereqs

This program runs on Windows 10 and Debian-based Linux, written in Python 3.9 and updated to version 3.10.6

Installation

• Run the setup.py script to build a virtual environment and install all external packages in the created venv.

Examples:
  - Windows: python setup.py venv
  - Linux: python3 setup.py venv

• Once virtual env is built traverse to the (Scripts-Windows or bin-Linux) directory in the environment folder just created.
• For Windows, in the venv\Scripts directory, execute activate or activate.bat script to activate the virtual environment.
• For Linux, in the venv/bin directory, execute source activate to activate the virtual environment.
• If for some reason issues are experienced with the setup script, the alternative is to manually create an environment, activate it, then run pip install -r packages.txt in project root.
• To exit from the virtual environment when finished, execute deactivate.

How to use

---

Note: python(3) means either python or python3 depending on Windows or Linux

bin - python(3) <input_bin_file> bin

text - python(3) <input_text_file> text

pdf - python(3) <input_pdf_file> pdf

sanitize - python(3) <input_wordlist> sanitize

scrape - python(3) --host <ip_address(4|6) | domain_name> --port <port_number> <input_wordlist> scrape

gobuster - python(3) --host <ip_address(4|6) | domain_name> --port <port_number> <input_gobuster_output> gobuster