Scrapoxy

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀. Here are the included features: - ☁️ Cloud Providers with easy installation: Scrapoxy supports many cloud providers like AWS, Azure, or GCP. - 🌐 Proxy Services: Scrapoxy supports many proxy services like Rayobyte, IPRoyal or Zyte. - 💻 Hardware materials: Scrapoxy supports many 4G proxy farms hardware types, like Proxidize or XProxy.io. - 📜 Free Proxy Lists: Scrapoxy supports lists of HTTP/HTTPS proxies and SOCKS4/SOCKS5 proxies. - ⏰ Timeout free: Scrapoxy only routes traffic to online proxies to avoid inactive connection. - 🔄 Auto-Rotate proxies: Scrapoxy automatically changes IP addresses at regular intervals. - 🏃 Auto-Scale proxies: Scrapoxy monitors incoming traffic and automatically scales the number of proxies according to your needs. It also reduces proxy count to minimize your costs. - 🍪 Sticky sessions on Browser: Scrapoxy can keep the same IP address for a scraping session, even for browsers. - 🚨 Ban management: Scrapoxy injects the name of the proxy into the HTTP responses. - 📡 Traffic interception: Scrapoxy intercepts HTTP requests/responses to modify headers, keeping consistency in your scraping stack. It can add session cookies or specific headers like user-agent. - 📊 Traffic monitoring: Scrapoxy measures incoming and outgoing traffic to provide an overview of your scraping session. - 🌍 Coverage monitoring: Scrapoxy displays the geographic coverage of your proxies to better understand the global distribution of your proxies. - 🚀 Easy-to-use and production-ready: Scrapoxy is suitable for both beginners and experts. It can be started in seconds using Docker, or be deployed in a complex, distributed environment with Kubernetes. - 🔓 Open Source: And of course, Scrapoxy is open source, under the MIT license.