[Enhancement] Eliminating the use of HTTPX in the Backend and directly wants to upload resolved subdomains to database
LatestTo achieve the goal of uploading resolved subdomains directly to the database without utilizing HTTPX in the backend, we need to implement a revised architecture for our system. This new design would involve using a more direct and efficient approach for resolving subdomains, such as utilizing a custom DNS resolver or implementing a dedicated subdomain resolution service. Users can now directly upload the list of huge subdomains list to the database directly and see a UI representation in recon-ninja
Overall, the revised architecture would offer significant benefits in terms of reduced processing overhead, improved performance, and simplified code complexity, making it a highly desirable solution for our use case.
Please use the following script as, for example you have a huge 100K subdomains resolved list which 100k.txt and you want to upload it directly to database, Please use the following script.py as
python3 script.py 100k.txt
This will now create 100k.json, now you can directly login to MongoDB compass and select import file and upload the list easily.