FC9: perl-libwww with HTTPS cuts HTML sites

Patrick Kirsch pkirsch at bookandsmile.de
Mon Oct 20 08:08:44 UTC 2008


Hey,
 who can enlighten me?
On a Fedora Core 9 installation with package
perl-libwww-perl-5.816-1.fc9.noarch and perl-5.10.0-34.fc9.x86_64 exists
following problem while downloading of following HTTPS based web sites:
-> the content (targeting the response of a request) will be shortened
on a random basis (this is not wanted!).

Running the script in the Perl debugger does not show a shortened scalar
or the loose of the content. I mean, running the script in the
debug/trace modus does not show the problem!

For the ease of reproduction I attached an example script (referenced as
"https.pl").

Please compare two runs:
 - one with "perl https.pl", that shows a shortened reply of the web site
 - one with "perl -t https.pl" (alternatively "perl -d https.pl"), thats
shows the correct reply of the web site.

The interesting situation is, that this bug (?) exists since the system
was upgraded from FC6 to FC9.
Other distributions like OpenSUSE 11.0 does not have this problem.

Last but no least:
 - If you also can confirm this, Shall I open a bug for that?

Script https.pl:

use LWP::UserAgent;
use Data::Dumper;
use strict;
use warnings;

  my $ua = LWP::UserAgent->new;
  $ua->agent("Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b5)
Gecko/2008032600 SUSE/2.9.95-25.1 Firefox/3.0b5");

#  $ua->max_size(100000);

 my $res = 
$ua->post('https://www.germanwings.com/skysales/Search.aspx?culture=en-GB&AvailabilitySearchInputSearchView%24RadioButtonMarketStructure=RoundTrip&AvailabilitySearchInputSearchView%24DropDownListMarketOrigin1=SXF&AvailabilitySearchInputSearchView%24DropDownListMarketDestination1=IBZ&AvailabilitySearchInputSearchView%24DropDownListMarketOrigin2=IBZ&AvailabilitySearchInputSearchView%24DropDownListMarketDestination2=SXF&AvailabilitySearchInputSearchView%24DropDownListFareTypes=R%2CF&AvailabilitySearchInputSearchView%24DropDownListMarketDay1=25&AvailabilitySearchInputSearchView%24DropDownListMarketMonth1=2008-10&AvailabilitySearchInputSearchView%24DropDownListMarketDateRange1=3%7C3&AvailabilitySearchInputSearchView%24DropDownListMarketDay2=30&AvailabilitySearchInputSearchView%24DropDownListMarketMonth2=1899-11&AvailabilitySearchInputSearchView%24DropDownListMarketDateRange2=3%7C3&AvailabilitySearchInputSearchView%24DropDownListPassengerType_ADT=1&AvailabilitySearchInputSearchView%24DropDownListPassengerType_CHD=0&AvailabilitySearchInputSearchView%24DropDownListPassengerType_INFANT=0&step=Select&__EVENTTARGET=AvailabilitySearchInputSearchView%24LinkButtonNewSearch&__EVENTARGUMENT=&__VIEWSTATE= <https://www.germanwings.com/skysales/Search.aspx?culture=en-GB&AvailabilitySearchInputSearchView%24RadioButtonMarketStructure=RoundTrip&AvailabilitySearchInputSearchView%24DropDownListMarketOrigin1=SXF&AvailabilitySearchInputSearchView%24DropDownListMarketDestination1=IBZ&AvailabilitySearchInputSearchView%24DropDownListMarketOrigin2=IBZ&AvailabilitySearchInputSearchView%24DropDownListMarketDestination2=SXF&AvailabilitySearchInputSearchView%24DropDownListFareTypes=R%2CF&AvailabilitySearchInputSearchView%24DropDownListMarketDay1=25&AvailabilitySearchInputSearchView%24DropDownListMarketMonth1=2008-10&AvailabilitySearchInputSearchView%24DropDownListMarketDateRange1=3%7C3&AvailabilitySearchInputSearchView%24DropDownListMarketDay2=30&AvailabilitySearchInputSearchView%24DropDownListMarketMonth2=1899-11&AvailabilitySearchInputSearchView%24DropDownListMarketDateRange2=3%7C3&AvailabilitySearchInputSearchView%24DropDownListPassengerType_ADT=1&AvailabilitySearchInputSearchView%24DropDownListPassengerType_CHD=0&AvailabilitySearchInputSearchView%24DropDownListPassengerType_INFANT=0&step=Select&__EVENTTARGET=AvailabilitySearchInputSearchView%24LinkButtonNewSearch&__EVENTARGUMENT=&__VIEWSTATE=>');
print $res->{_content};
my $a = length $res->{_content};
my $b = $res->{_content};
my $c = length $b;
print ">$a<, $c, ".length($res->{_content})." \n";



Regards,


Disclaimer: Ich hope that the cooperation of Germanwings forbears that I have choosen their website as reference.

 -- 
Software Developer

Bookandsmile GmbH
Inselstraße 20
04103 Leipzig
Tel: 0341 / 30 89 51 12
-
Skype: undef
Email: Patrick.Kirsch at bookandsmile.de
Web: http://www.billigflieger.de | http://www.bookandsmile.de







More information about the redhat-list mailing list