There will be cases where your proxies will not be able to connect to a certain site. It could happen that they are not able to connect as soon as they are delivered or after a certain time of use. If you encounter such issue, your proxy or set of proxies are most likely banned.
It is important to understand that different websites implement different security measures. Some of these are predictable and obvious, while other reasons are only theoretical guesses.
Why did I get banned?
1. You are using your proxies too fast
One of the main reasons for getting banned on a website is that you have your software configured to run too fast. Websites will not tolerate significant, parallel, connections as it may cause harm to their services. If a single IP attempts to connect at a rate that maxes out what the site can accommodate, expect that the site will ban access from that IP.
What is the appropriate speed that you can connect to the site you are using the proxies on? Unfortunately, that's a hard question to answer, but what we recommend is that people run their own experiments to find that rate:
- Set your software to run at a slow speed that will not cause a ban (ex: 1 request per hour)
- If you do not receive a ban at that rate, then increase it higher (ex: 2 requests per hour)
- Repeat this until you receive a ban, and then set your rate at the previous rate before
2. You are running at an optimal rate and some of your proxies work, but others do not
The next question we frequently receive is customers asking why some of their proxies work, and why some of their proxies are banned. This is an unfortunate side effect of how IPv4 address schema works and why it impacts proxies.
There are two terms used frequently in the proxy business:
Subnets (A, B, C subnets - read here for more info)
ISPs (or ASNs). Example: Verizon is an ISP; Sprious is an ISP; etc
Why do subnets and ISPs (Internet Service Providers) matter in terms of proxies? Websites are able to easily determine if certain subnets or ISPs are being used to target them. With this, they are able to implement bans on that whole subnet or those sourced from the same ISP.
Given that the proxy industry is driven largely by certain niches (Scraping, social media marketing, and others), it's very common that many customers are using proxies for the same use case as yours. With some websites implementing IP bans on a subnet/ISP level, there will really be instances where some proxies you get will not work or those you have been using may no longer connect after some time.
What can I do about my proxies being banned?
In this section we will cover various options you have to be more successful with your proxies with Rayobyte:
- From day one, Rayobyte made it a top priority that our customers could have the freedom to automatically replace their proxies if any of them were not working for any reason.
- If you run out of replacements, please contact us and our support team will assist you with restoring the replacements.
- Slow your proxy speed down: As discussed in the previous section, sometimes it just requires you to slow down your rates a little in order to achieve maximum throughput.
- Contact us.
- If pricing is a problem at the rates you are running your proxies now, please contact us and we can discuss custom pricing that will make you the most profitable.
- There are a number of strategies we can offer you (at no additional cost) that will give your account better proxies. This includes only giving you IPs from certain ISPs/ASNs and only IPs from certain subnets that appear to work better for your use case.
- The reason that certain IPs on certain ISPs or subnets work better than others is that some ISPs that we partner with are on "blacklists" for certain use cases. By configuring your account to receive IPs from ISPs/subnets that work for you, you will inherently avoid getting IPs from the "blacklisted" ISPs/subnets
Did you know: Rayobyte has IPs spread across:
- 7 different ISPs/ASNs
- Thousands of unique C-class subnets. Just look at one of our partner's IP diversity here.
In this article, we talked about why your proxies may be banned or blocked. At the end of the day, we are committed to providing you successful proxies and we have a number of customized approaches to do exactly that.
Please reach out to us if you need further assistance.