deepweb

Deep Web Scanner

This script finds websites that can be reached by IPV4 address and stores their metadata. The issue in the terminal is filtered according to certain keywords, but all websites achieved are in the log file.

What do you find? Webcams, niche websites and interesting dashboards.

The same results can be reached with the Shodan Internet search engine or partly with Google.

IP addresses

The input file is a CSV that contains IP addresses from Germany. The IP rank should be in the format: 1.1.1.1-2.2.2.2. The IP addresses come from this project: https://github.com/sapics/ip-location-db

Prerequisite

• Python 3.9

If you are on Python 3.8, you can install Python 3.9 in parallel. Then the desired version must be explicitly specified. python3 remains the version 3.8:

sudo apt install python3.9
python3.9 -m pip install -r requirements.txt
python3.9 deep-web-scanner.py

installation

Install the required packages:

pip3 install -r requirements.txt

Start

Starts the scanner with standard values. Execute in the terminal and in the right folder:

python3 deep-web-scanner.py

Options:

• -i input.txt: input file
• -o output.txt: output file
• -indexof true: logs index of files (default: false)

"Index of"

This option shows available files: -indexof true :

python3 deep-web-scanner.py -indexof true 

Search

You can quickly search with grep via the text file.

grep -i " nginx " deep-web.txt