[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: Off the wall quuestion about browsing.



On Sun, Mar 01, 2009 at 15:08:31 +0100,
  Kevin Kofler <kevin kofler chello at> wrote:
> Hiisi wrote:
> > By the way, your browser sends some information about your system and
> > even language you're using on it in a special header. My favourite
> > Fedora' browser - lynx - doesn't send it. Because of that I can't browse
> > some pages. Error message on them says: `Sorry. Probably you're robot!`.
> 
> Lynx actually sends a valid user agent, but some stupid sites block
> Lynx. :-/ You can set the user agent string in the options, changing Lynx
> to something like |_yn>< will probably make it pass. Or just copy the UA
> used by Firefox or Konqueror. ;-) But you should also complain to the
> site's webmaster about the stupid UA blocking.

The user agent header isn't even required. The robot blocking via the user
agent header is stupid, as the good robots will pay attention to the directives
governing their behavior and the evil ones will pretend to be IE.


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]