Looking for some apache config help to block evil spiders

Sharpe, Sam J sam.sharpe+lists.redhat at gmail.com
Sat Oct 10 18:59:31 UTC 2009


2009/10/10 Sharpe, Sam J <sam.sharpe+lists.redhat at gmail.com>:
> 2009/10/10 Steven W. Orr <steveo at syslang.net>:
>> RewriteCond %{HTTP_USER_AGENT}  ^Baiduspider.* [OR]
>> RewriteCond %{HTTP_USER_AGENT}  ^msnbot.* [OR]
>> RewriteCond %{HTTP_USER_AGENT}  ^NaverBot.* [OR]
>> RewriteCond %{HTTP_USER_AGENT}  ^Sogou-Test-Spider.*
>> RewriteCond %{HTTP_USER_AGENT}  ^Mozilla/4.0.*
>> RewriteCond %{HTTP_USER_AGENT}  ^T-Mobile Dash.*
>> RewriteRule .* - [F,L]
>
> Are you actually missing the [OR] at the end of the 4th and 5th
> RewriteCond lines, or is that a mispaste...
>
> If you are missing the [OR] then you are only matching things that
> starts with any of the top four matches AND Mozilla/4.0 AND T-Mobile
> Dash (somewhat mutually exclusive!)...

I found this for a customer today, it's a cracking read and has some
great pre-written ways of blocking this kind of thing:
http://www.askapache.com/htaccess/fight-blog-spam-with-apache.html


-- 
Sam




More information about the fedora-list mailing list