Network glitches costing 15 minutes a pop

Mark Hammond mhammond at skippinet.com.au
Fri Aug 15 01:46:07 BST 2008


Fairly regularly, I notice pulling a small number of updates from launchpad
can take a very long time - 30 minutes isn't uncommon.  Looking in the logs,
I see:

...
34.219  http readv of b9079703ef4bc0a8975cfc8809aa122e.pack  offsets => 3
collapsed 2
34.946  http readv of 5a4f2c46b38ea8f69400e7216da83b89.tix  offsets => 2
collapsed 2
937.223  got pycurl error: 18, transfer closed with 65726 bytes remaining to
read, (18, 'transfer closed with 65726 bytes remaining to read'), url:
http://bazaar.launchpad.net/%7Ebzr/bzr/bzr.1.6/.bzr/repository/indices/5a4f2
c46b38ea8f69400e7216da83b89.tix 
937.223  Exception ShortReadvError(): readv() read unknown bytes rather than
unknown bytes at unknown for
"http://bazaar.launchpad.net/%7Ebzr/bzr/bzr.1.6/.bzr/repository/indices/5a4f
2c46b38ea8f69400e7216da83b89.tix": Server aborted the request during
http._readv
937.223  http readv of 5a4f2c46b38ea8f69400e7216da83b89.tix  offsets => 2
collapsed 2
... <going again at a good pace>
960.089  http readv of 5a4f2c46b38ea8f69400e7216da83b89.six  offsets => 2
collapsed 2
1860.905  got pycurl error: 18, transfer closed with 65723 bytes remaining
to read, (18, 'transfer closed with 65723 bytes remaining to read'), url:
http://bazaar.launchpad.net/%7Ebzr/bzr/bzr.1.6/.bzr/repository/indices/5a4f2
c46b38ea8f69400e7216da83b89.six
1860.905  Exception ShortReadvError(): readv() read unknown bytes rather
than unknown bytes at unknown for
"http://bazaar.launchpad.net/%7Ebzr/bzr/bzr.1.6/.bzr/repository/indices/5a4f
2c46b38ea8f69400e7216da83b89.six": Server aborted the request during
http._readv
... <going again>
etc

Note the 15 minute gap before the 'got pycurl error: 18' messages.  If I'm
unlucky, I'll see a number of such errors in a single pull (I just got 2
pulling the 1.6 branch).  I've witnessed this problem on at least 2 machines
from different networks.  You see no indication that an error occurred -
unless you look at the log it just appears either bzr or launchpad is
excruciatingly slow.  Off the top of my head, I see at least 1 such error
every 3rd time pulling from Launchpad.

It seems to me that little network glitches aren't particularly unexpected -
but waiting 15 minutes when it happens isn't that friendly.  Is this
something specific to Windows?  Specific to pycurl?  Any suggestions about
what we can do to make such errors have less of an impact?

Thanks,

Mark





More information about the bazaar mailing list