On Wed, 2008-07-23 at 14:03 -0700, Toshio Kuratomi wrote:
Mike Bonnet wrote:
On Wed, 2008-07-23 at 15:56 -0400, Naveen Gavini wrote:
Hello all,
When importing or building RPM's from source is there an option that is throttling the upload speed of the package? We are seeing speeds of 10kbps which makes importing/building large packages very slow.
Package upload happens via xml-rpc, and to avoid holding the entire contents of the file in memory, it's done in chunks. Unfortunately python xml-rpc libs don't support keep-alive, so if you're using SSL authentication you incur the non-trivial SSL connection setup/teardown overhead for every chunk, in addition to the TCP connection setup/teardown. The chunk size in your version is probably very small (64k?). That has been increased in the Koji repo, but not released yet. The next version will improve this situation somewhat.
Any chance we could port to pycurl which does support keep-alive? Or is urllib pretty deeply embedded in the code ATM?
I don't know anything about pycurl, but the transport layer is decently separated from the XML-RPC layer in xmlrpclib, so it should be possible to replace that it with a transport that supports SSL and keep-alive. I haven't looked at how much work this might be though.
-Toshio
-- Fedora-buildsys-list mailing list Fedora-buildsys-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-buildsys-list