Unsolved A Small Orange - bandwidth limit exceded
-
If they are bots, Wordfence has an option to automatically block "fake Google crawlers" found under Wordfence -> Firewall -> Rate Limiting. Wordfence is free for many of it's features but also offers some premium features for paid option.
Something else to watch for is, I noticed that Google crawlers were going ape$hit for a while crawling a couple sites I manage to the tune of hundreds of pages per day. That's since calmed down though. Right around the time I submitted a sitemap to Google Search Console.
-
@Danp said in A Small Orange - bandwidth limit exceded:
Have you looked into WordFence?
Thanks for the tip. WordFence was the first thing to let me see what's going on. The live view feature let me see the requests and where they are coming from. Mostly it's IPs from all over the world that are trying to pull up admin and register pages that don't exist.
I let it run for a few hours and it didn't put a dent in the traffic, so I just tweaked some of the settings so that it will start blocking after 20 failed attempts for different things. We'll see how it looks tomorrow.
-
@NashBrydges said in A Small Orange - bandwidth limit exceded:
If they are bots, Wordfence has an option to automatically block "fake Google crawlers" found under Wordfence -> Firewall -> Rate Limiting. Wordfence is free for many of it's features but also offers some premium features for paid option.
They are bots. When I adjust the filter to "humans" it shows no hits. I turned on the "fake google crawler" rule. We'll see what it looks like tomorrow.
-
After 2 minutes I've had to turn off "Alert when an IP address is blocked".
-
Those changes didn't make a dent in the traffic. I set WordFence to block bots after 1 404 error. We'll see what that does.
-
That's so crazy that you are getting SO much traffic.
-
I have to wonder if I should just move to a new host or something. I can't explain why they are pounding on my site so hard.
-
What are they trying to do when they call the: http://www.domainname.com/?ctl=register page?
-
I think I may have figured it out. The site used to be hosted on an IIS box running .net nuke. .net nuke was vulnerable to users registering themselves and creating a link back to their page. (link juice for SEO optimization) It seems that after I moved the site, they are still trying to hack the registration from when the site was on DNN.
I just updated wordFence to block on the url "/?ctl=register" and /*/Default.aspx so now it's blocking most attempts.
-
CloudFlare is still seeing the same amount of traffic, but ASmallOrange is seeing way less bandwidth. (It's actually reading 0 for the day.) The WordFence live feed is a constant stream of blocked requests.
-
@IRJ said in A Small Orange - bandwidth limit exceded:
There are also plenty of FREE plugins that do this with one click.
https://wordpress.org/plugins/rename-wp-login/
https://wordpress.org/plugins/protect-wp-admin/
Wordfence also lets you do this and restrict IPs to the admin page.
I'm trying to make this as the solution to the problem. The other tools weren't telling me what was going on because they were showing me what pages were served, not what pages were asked for an unresolved. WordFence was able to show me that spammers were trying to register through .aspx pages that the old .netNuke site used. By banning those pages, my bandwidth consumption has gone down. I'm curious to see how long they have to get 404s before they will stop making requests.
-
Anyone mention web crawlers on here? Indexing servers (like Google) will hit a website over and over again looking for changes to catalog and add to their index.
Try adding a robots.txt to the root (http://www.robotstxt.org/robotstxt.html(
-
@jrc Don't I want the legit robots to hit my site and see that it's not running .netNuke anymore so the script kiddies will leave the site alone?
-
Do you need it findable on search engines? If the answer is no, then I don't think you need it indexed by the robots out there. Unless they do something else that I am not aware of (very possible).
Just remember that when a robot hits your site, it will generate bandwidth, and if you have a lot of them doing so, then you'd generate a lot of bandwidth. I vaguely recall someone else having an issue that was very similar to yours here, and the solution was denying robots access. No idea where I heard about it, may have been on Security Now, though I really am not sure.
-
@Mike-Davis said in A Small Orange - bandwidth limit exceded:
@IRJ said in A Small Orange - bandwidth limit exceded:
There are also plenty of FREE plugins that do this with one click.
https://wordpress.org/plugins/rename-wp-login/
https://wordpress.org/plugins/protect-wp-admin/
Wordfence also lets you do this and restrict IPs to the admin page.
I'm trying to make this as the solution to the problem. The other tools weren't telling me what was going on because they were showing me what pages were served, not what pages were asked for an unresolved. WordFence was able to show me that spammers were trying to register through .aspx pages that the old .netNuke site used. By banning those pages, my bandwidth consumption has gone down. I'm curious to see how long they have to get 404s before they will stop making requests.
Click the menu button below the post and select mark as answer (not visible in this screenshot asn I did not make this topic).
-
@jrc said in A Small Orange - bandwidth limit exceded:
Anyone mention web crawlers on here? Indexing servers (like Google) will hit a website over and over again looking for changes to catalog and add to their index.
Try adding a robots.txt to the root (http://www.robotstxt.org/robotstxt.html(
They should not create traffic anything like that.
