Launchpad is now open sourced

[Ben Finney]

Jonathan Lange <jml at mumak.net> writes:

> Get the code at: https://dev.launchpad.net

I started fetching the code (via ‘bzr branch
http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/’) this
morning and left it running. Several hours later, the machine was
brought to its knees thrashing memory; the ‘bzr’ process was using
nearly 500MiB of RAM before I killed it.

Any clues? I'm right that the process shouldn't be using anywhere near
that much RAM for a branch operation, yes?

This is using Bazaar 1.16.1. The log for the session is::

=====
Wed 2009-07-22 07:28:52 +1000
0.225  bzr arguments: [u'branch', u'http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/', u'devel']
0.407  looking for plugins in /home/benf/.bazaar/plugins
0.415  looking for plugins in /usr/lib/python2.5/site-packages/bzrlib/plugins
1.246  encoding stdout as sys.stdout encoding 'UTF-8'
1.417  bzr-svn: using Subversion 1.5.6 ()
12.774  creating repository in file:///var/local/launchpad/launchpad/devel/.bzr/.
12.821  Using fetch logic to copy between CHKInventoryRepository('http://bazaar.launchpad.net/%7Elaunchpad-pqm/launchpad/devel/.bzr/repository/')(<RepositoryFormat2a>) and CHKInventoryRepository('file:///var/local/launchpad/launchpad/devel/.bzr/repository/')(<RepositoryFormat2a>)
26.523  25 bytes left on the HTTP socket
28.181  25 bytes left on the HTTP socket
29.422  25 bytes left on the HTTP socket
30.339  25 bytes left on the HTTP socket
31.264  25 bytes left on the HTTP socket
32.173  25 bytes left on the HTTP socket
33.957  25 bytes left on the HTTP socket
36.079  25 bytes left on the HTTP socket
38.560  25 bytes left on the HTTP socket
41.031  25 bytes left on the HTTP socket
44.358  25 bytes left on the HTTP socket
45.547  25 bytes left on the HTTP socket
48.639  25 bytes left on the HTTP socket
50.605  25 bytes left on the HTTP socket
52.460  25 bytes left on the HTTP socket
54.628  25 bytes left on the HTTP socket
65.119  25 bytes left on the HTTP socket
84.357  25 bytes left on the HTTP socket
218.554  25 bytes left on the HTTP socket
237.363  25 bytes left on the HTTP socket
256.721  25 bytes left on the HTTP socket
271.971  25 bytes left on the HTTP socket
284.223  25 bytes left on the HTTP socket
378.021  25 bytes left on the HTTP socket
400.076  25 bytes left on the HTTP socket
532.381  25 bytes left on the HTTP socket
547.951  25 bytes left on the HTTP socket
562.751  25 bytes left on the HTTP socket
575.709  25 bytes left on the HTTP socket
590.226  25 bytes left on the HTTP socket
602.758  25 bytes left on the HTTP socket
614.215  25 bytes left on the HTTP socket
622.094  25 bytes left on the HTTP socket
906.572  stripping trailing bytes from groupcompress block 11046 => 10048
907.043  creating new compressed block on-the-fly in 0.015s 11139 bytes => 365 bytes
907.045  stripping trailing bytes from groupcompress block 11046 => 275
907.053  creating new compressed block on-the-fly in 0.005s 11139 bytes => 2757 bytes
907.065  creating new compressed block on-the-fly in 0.000s 11046 bytes => 269 bytes
907.068  creating new compressed block on-the-fly in 0.002s 11139 bytes => 917 bytes
907.079  creating new compressed block on-the-fly in 0.005s 11046 bytes => 2832 bytes
907.103  creating new compressed block on-the-fly in 0.012s 11139 bytes => 5331 bytes
907.130  creating new compressed block on-the-fly in 0.001s 11046 bytes => 782 bytes
907.140  creating new compressed block on-the-fly in 0.006s 11139 bytes => 2386 bytes
911.973  stripping trailing bytes from groupcompress block 10569 => 2699
911.992  creating new compressed block on-the-fly in 0.003s 11139 bytes => 1256 bytes
912.063  creating new compressed block on-the-fly in 0.003s 11046 bytes => 1422 bytes
912.073  creating new compressed block on-the-fly in 0.001s 10569 bytes => 637 bytes
912.572  creating new compressed block on-the-fly in 0.002s 11140 bytes => 922 bytes
912.582  creating new compressed block on-the-fly in 0.004s 10569 bytes => 2287 bytes
914.788  creating new compressed block on-the-fly in 0.007s 97469 bytes => 3114 bytes
914.804  creating new compressed block on-the-fly in 0.001s 11690 bytes => 364 bytes
914.810  creating new compressed block on-the-fly in 0.003s 97469 bytes => 1708 bytes
914.819  creating new compressed block on-the-fly in 0.001s 11690 bytes => 552 bytes
914.842  stripping trailing bytes from groupcompress block 97469 => 60334
915.137  creating new compressed block on-the-fly in 0.001s 11690 bytes => 518 bytes
915.140  creating new compressed block on-the-fly in 0.000s 11140 bytes => 272 bytes
915.145  creating new compressed block on-the-fly in 0.003s 11046 bytes => 1167 bytes
915.154  creating new compressed block on-the-fly in 0.001s 11690 bytes => 367 bytes
915.157  creating new compressed block on-the-fly in 0.000s 10569 bytes => 274 bytes
915.180  stripping trailing bytes from groupcompress block 97469 => 95231
916.418  creating new compressed block on-the-fly in 0.002s 67442 bytes => 1158 bytes
916.423  creating new compressed block on-the-fly in 0.000s 97469 bytes => 275 bytes
916.427  creating new compressed block on-the-fly in 0.002s 67442 bytes => 1145 bytes
916.433  creating new compressed block on-the-fly in 0.001s 97469 bytes => 335 bytes
916.439  creating new compressed block on-the-fly in 0.003s 67442 bytes => 1431 bytes
916.448  creating new compressed block on-the-fly in 0.002s 97469 bytes => 919 bytes
916.459  stripping trailing bytes from groupcompress block 67442 => 18365
916.560  creating new compressed block on-the-fly in 0.004s 97469 bytes => 1750 bytes
916.945  creating new compressed block on-the-fly in 0.001s 97469 bytes => 462 bytes
1216.304  stripping trailing bytes from groupcompress block 1606 => 781
1220.875  creating new compressed block on-the-fly in 0.034s 4194070 bytes => 14476 bytes
1221.012  creating new compressed block on-the-fly in 0.049s 4194070 bytes => 18412 bytes
1221.112  25 bytes left on the HTTP socket
1260.920  25 bytes left on the HTTP socket
1280.433  25 bytes left on the HTTP socket
1302.150  25 bytes left on the HTTP socket
1571.576  25 bytes left on the HTTP socket
1593.917  25 bytes left on the HTTP socket
1616.289  25 bytes left on the HTTP socket
1645.500  25 bytes left on the HTTP socket
1680.014  25 bytes left on the HTTP socket
1708.968  25 bytes left on the HTTP socket
1725.226  25 bytes left on the HTTP socket
1746.565  25 bytes left on the HTTP socket
1776.477  25 bytes left on the HTTP socket
1798.688  25 bytes left on the HTTP socket
1822.158  25 bytes left on the HTTP socket
1852.979  25 bytes left on the HTTP socket
1876.772  25 bytes left on the HTTP socket
1889.731  25 bytes left on the HTTP socket
2146.516  25 bytes left on the HTTP socket
2151.017  25 bytes left on the HTTP socket
2207.163  25 bytes left on the HTTP socket
2931.298  25 bytes left on the HTTP socket
2934.646  25 bytes left on the HTTP socket
3355.075  25 bytes left on the HTTP socket
3448.855  25 bytes left on the HTTP socket
3587.626  25 bytes left on the HTTP socket
3733.785  25 bytes left on the HTTP socket
3838.662  25 bytes left on the HTTP socket
4056.445  25 bytes left on the HTTP socket
4303.845  25 bytes left on the HTTP socket
4351.026  25 bytes left on the HTTP socket
4397.424  25 bytes left on the HTTP socket
5462.680  25 bytes left on the HTTP socket
5990.125  25 bytes left on the HTTP socket
6052.255  25 bytes left on the HTTP socket
6094.487  25 bytes left on the HTTP socket
6799.858  25 bytes left on the HTTP socket
6849.735  25 bytes left on the HTTP socket
7579.254  25 bytes left on the HTTP socket
7628.237  25 bytes left on the HTTP socket
8371.948  25 bytes left on the HTTP socket
9838.441  25 bytes left on the HTTP socket
10751.101  25 bytes left on the HTTP socket
10803.795  25 bytes left on the HTTP socket
12025.434  25 bytes left on the HTTP socket
12081.643  25 bytes left on the HTTP socket
13343.465  25 bytes left on the HTTP socket
14183.521  25 bytes left on the HTTP socket
14198.422  25 bytes left on the HTTP socket
14203.018  25 bytes left on the HTTP socket
14208.094  25 bytes left on the HTTP socket
14212.947  25 bytes left on the HTTP socket
14215.860  25 bytes left on the HTTP socket
15786.887  25 bytes left on the HTTP socket
=====

-- 
 \       “Anyone who puts a small gloss on [a] fundamental technology, |
  `\          calls it proprietary, and then tries to keep others from |
_o__)           building on it, is a thief.” —Tim O'Reilly, 2000-01-25 |
Ben Finney