proxy scraper checker

HTTP, SOCKS4, SOCKS5 proxies scraper and checker with support of determining exit-node's geolocation for each proxy.

monosans
118
38
Python

🚀 proxy-scraper-checker

CI

TUI Demo

A lightning-fast, feature-rich proxy scraper and checker built in Rust.

Collect, test, and organize HTTP/SOCKS4/SOCKS5 proxies from multiple sources with detailed metadata and intelligent filtering.

✨ Key Features

  • 🔥 Blazing Performance - Rust-powered async engine with configurable concurrency
  • 🌍 Rich Metadata - ASN, geolocation, and response time data via offline MaxMind databases
  • 🎯 Smart Parsing - Advanced regex engine extracts proxies from any format (protocol://user:pass@host:port)
  • 🔐 Auth Support - Handles username/password authentication seamlessly
  • 📊 Interactive TUI - Real-time progress monitoring with beautiful terminal interface
  • ⚡ Flexible Output - JSON (with metadata) and plain text formats
  • 🎛️ Configurable - Extensive options for sources, timeouts, and checking
  • 📁 Local & Remote - Supports both web URLs and local files as proxy sources
  • 🐳 Docker Ready - Containerized deployment with volume mounting

🔗 Related

Get pre-checked proxies from monosans/proxy-list - updated regularly using this tool.

⚠️ SAFETY WARNING ⚠️

This tool makes many network requests and can impact your IP-address reputation. Consider using a VPN for safer operation.

🚀 Quick Start

All configuration options are documented in config.toml - edit it to customize sources, timeouts, and output preferences.

💻 Binary Installation

Note: For Termux users, see the dedicated section below.

  1. Download the appropriate binary from nightly builds

  2. Extract the archive to a dedicated folder

  3. Configure by editing config.toml to your needs

  4. Run the executable

🐳 Docker Installation

Note: Docker version uses a simplified log-based interface (no TUI).

  1. Install Docker Compose

  2. Download the docker archive from nightly builds

    • Look for artifacts named proxy-scraper-checker-docker

  3. Extract to a folder and configure config.toml

  4. Build and run:

    # Windows
docker compose build
docker compose up --no-log-prefix --remove-orphans

# Linux/macOS
docker compose build --build-arg UID=$(id -u) --build-arg GID=$(id -g)
docker compose up --no-log-prefix --remove-orphans
📱 Termux Installation

Important: Download Termux from F-Droid, not Google Play (why?).

  1. Auto-install with one command:

    bash <(curl -fsSL 'https://raw.githubusercontent.com/monosans/proxy-scraper-checker/main/termux.sh')

  2. Configure using a text editor:

    nano ~/proxy-scraper-checker/config.toml

  3. Run the tool:

    cd ~/proxy-scraper-checker && ./proxy-scraper-checker

📄 License

MIT

This product includes GeoLite2 Data created by MaxMind, available from https://www.maxmind.com