[MERGE] chunked sftp readv

John Arbash Meinel john at arbash-meinel.com
Thu Sep 4 04:04:33 BST 2008


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

The attached patch changes how our SFTP readv code processes requests. The big
change is to just yield data as it comes in, as soon as we are able to, rather
than parsing it into a data map, and *then* yielding it.

In the process of writing this, I came across the more trivial patch I posted,
which on the loopback connection, gives approximately the same speed.

The idea with this one, is more for when you are bandwidth limited, rather
than latency limited. So you can do more processing while you are waiting for
the next chunks to stream in over the wire.

I haven't seen a net win with this, so I'm not planning on trying to push it
very hard. But I thought something like this might be a good basis for
revisiting the HPSS code, and trying to get it to buffer less before returning
data.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIv1BBJdeBCYSNAAMRAnEpAJ0Vav2hKUBK5RgH0xMkEgy8ZlRKAgCg10Zv
+c4BSQJjMReWg+mCVBEytRw=
=Ld7i
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sftp_chunked.patch
Type: text/x-diff
Size: 32494 bytes
Desc: not available
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20080903/4f84969e/attachment-0001.bin 


More information about the bazaar mailing list