Why is a Chinese reader zipping through my (friend's) blog at a rate of one post a second?
-
Why is a "reader" zipping through a friend's blog at a rate of one post a second? Friend of mine has a modest but, in its niche, not entirely obscure blog. Not commercial, just informational. It has visitor counting software with live updates. Someone in China or Germany or both is currently going through the whole thing at a rate too fast to be read but presumably not to be copied. This can't be good. The question is, exactly how can this not be good? What to expect, what, if anything, to do?
-
Answer:
If he's running his own Wordpress installation, he should have http://wordpress.org/extend/plugins/akismet/ installed as a minimum and I would suggest adding http://wordpress.org/extend/plugins/bad-behavior/ as well since it can be setup to block these kinds of things before they even get to drop their spammy comments.
IndigoJones at Ask.Metafilter.Com Visit the source
Other answers
It's most likely a search engine bot - the site is being indexed.
DarlingBri
A "scraper" is not necessarily nefarious. There are programs that are designed to download an entire site at a time, so that the user can refer to it offline. That may be the nature of the bot in question.
yclipse
It's a bot. Most likely it's the sort of bot that is likely to leave a comment like, "Good post, really contains a lot of information I can find useful about this topic. Another beneficial good place to check out cool info like it is (link to some sort of commercial and/or phishing site). Thanks have a good day." Or whatever. Anyway, it's a bot, not a person. Advise him to keep an eye on the comments on his entries. It may also be a bot looking for specific vulnerabilities in his blogging software, in which case I'd advise him to read up on whatever current known exploits exist, just to be safe. But the former case seems more likely to me.
FAMOUS MONSTER
Seconding bot. Also, consider that the purpose of this would be to set up a clone somewhere for SEO purposes. Bot clones entires site, hosts it somewhere else and add tons of ads and/or outgoing links to various customers.
Foci for Analysis
They are probably scraping the content, and probably wants hand written content so they can spam forums or others blogs with their own ads without setting off the filters. It's usually good practice to throttle it slow enough to not be detected or to not throw off any monitoring alarms.
wongcorgi
akismet installed and bad behaviour recommended. Plenty of spam in the past, but none (yet) seems to be associated with this current nonsense. It's usually good practice to throttle it slow enough to not be detected or to not throw off any monitoring alarms. In the simplest terms, how is this achieved? Throttle what slow enough? Bot clones entires site, hosts it somewhere else and add tons of ads and/or outgoing links to various customers. Sounds bad. Any way to stop this?
IndigoJones
>> Sounds bad. Any way to stop this? Not really. Scrapers gonna scrape. The server sysadmins can do things that'll, but there's not a great way to stop it no matter what. They'll find ways around most anything. >> In the simplest terms, how is this achieved? Throttle what slow enough? http://wordpress.org/extend/plugins/throttle/ there are others. Also can be done by the sysadmins. Really, it happens to ALL blogs, I bet mefi gets crazy numbers of scrapers stealing content. See Also: http://blog.unmaskparasites.com/2010/04/14/introduction-to-website-parasites/
Blake
Also, checkout https://www.cloudflare.com/. It's an extremely simple to use Content Delivery Network that has some additional security tools which prevent these bots from even accessing your website in the first place.
joinks
I get these on my server all the time. They ignore my "robots" file and go ahead and dump the place. I've found that the vast majority of them are in China, Russia, or Ukraine. Ultimately the only solution I've found is to block them in my firewall. Or grin and bear it.
Chocolate Pickle
Related Q & A:
- How can I hook up a Dual Tuner dvr to a second tv?Best solution by Yahoo! Answers
- Why can't I view my friend's webcam?Best solution by Yahoo! Answers
- Can I have a second bachelor's degree in the USA?Best solution by sasundergrad.rutgers.edu
- How do you post a blog on yahoo answers?Best solution by Yahoo! Answers
- How to post a Youtube video into my blog?Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.