Off the wall quuestion about browsing.

Bruno Wolff III bruno at wolff.to
Sun Mar 1 15:42:47 UTC 2009


On Sun, Mar 01, 2009 at 15:08:31 +0100,
  Kevin Kofler <kevin.kofler at chello.at> wrote:
> Hiisi wrote:
> > By the way, your browser sends some information about your system and
> > even language you're using on it in a special header. My favourite
> > Fedora' browser - lynx - doesn't send it. Because of that I can't browse
> > some pages. Error message on them says: `Sorry. Probably you're robot!`.
> 
> Lynx actually sends a valid user agent, but some stupid sites block
> Lynx. :-/ You can set the user agent string in the options, changing Lynx
> to something like |_yn>< will probably make it pass. Or just copy the UA
> used by Firefox or Konqueror. ;-) But you should also complain to the
> site's webmaster about the stupid UA blocking.

The user agent header isn't even required. The robot blocking via the user
agent header is stupid, as the good robots will pay attention to the directives
governing their behavior and the evil ones will pretend to be IE.




More information about the fedora-list mailing list