[MERGE][bug #172701] Catch pycurl short reads and allows readv to issue several GET requests

[John Arbash Meinel]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Vincent Ladeuil wrote:
...

> No, I'm rewriting the http response parsing which should solve
> the problem in a better way. If *that* doesn't work I'll look
> into it, otherwise I prefer to minimize the requests issued.

It is the wrong fix, yes. But it is the 30s fix. I guess I can wait until you
give me the uber-wonderful readv stream processing.

> 
> Also note that another solution, in the readv case, will be to
> try to issue all the GET requests and process the responses as
> they come back (httplib seems to be able to handle such a scheme,
> but that may be more work than just spawning a thread as paramiko).
> 
>       Vincent
> 

That sounds interesting. I would be worried that one would fail (for whatever
reason) and then you would have a messed up queue.

Also, would that pipeline the request? Would it properly reconnect for
HTTP/1.0, and when you get a Connection: close response?

If you can get it done, I'm very much looking forward to reviewing an
incremental HTTP readv parser.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFHUEvZJdeBCYSNAAMRAoekAJ9hBZHrvWajjco9SldsF51A6CuHqACfQOck
K/lWR+8a7d4iwd8B3Y6oadc=
=+e5a
-----END PGP SIGNATURE-----