Johannes Knoedtel 3d5f7a3947 [utils] Prevent override of custom headers. ...

The dict of headers of request objects in urllib has its keys always
capitalized.

This causes the lookup to fail and overwrite the header. If for example
a Extractor tries to add a "User-Agent" header the internal
representation in the request object is "User-agent". The header is
therefore clobbered by the "User-Agent" in std_headers, because the
strings are not equal.

2015-01-12 22:38:51 +01:00

49 KiB

Raw Blame History

View Raw