Bzr with really big trees

[Lars Wirzenius]

[ I'm not currently subscribed to the bazaar-ng mailing list. Please Cc
me if you want me to see your reply. Thanks. ]

I recently had a weird urge to see how well bzr works with big trees. As
in: could it handle a tree that contained the entire Debian source
archive. I wrote a quick script (attached) to add unpacked Debian source
packages to a bzr branch, and ran it against my local mirror. The
results are in logfile.txt (attached). 

Briefly: at about 136 packages, and 66 000 files, a "bzr add; bzr
commit" takes about 240 seconds. That's a very small part of the entire
Debian source archive, but, of course, a pretty big tree for a single
project. I doubt any real projecs have such big trees, and for real use
I would not put the entire Debian source archive into one tree with any
version control system, but of course it would be cool if it were
possible.

This is not a bug report, and Robert Collins told me on IRC that it is a
known issue. I'm mailing you in case this interests you. If you fix this
and want me to re-run the test, I'd be more than happy to.

-- 
Never underestimate the power of a small tactical Lisp interpreter.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: debian-source-to-bzr
Type: application/x-shellscript
Size: 2027 bytes
Desc: not available
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20060301/f1f3bbc4/attachment.bin 
-------------- next part --------------
2006-03-01 10:21:44: acl-installer_6.2.32.dsc
2006-03-01 10:21:44: bzr took 0 seconds to add+commit
2006-03-01 10:21:44: acx100_0.2.0pre8+52-1.dsc
2006-03-01 10:21:45: bzr took 0 seconds to add+commit
2006-03-01 10:21:45: acx100_20051202-1.dsc
2006-03-01 10:21:46: bzr took 0 seconds to add+commit
2006-03-01 10:21:46: afbinit_1.0-1.dsc
2006-03-01 10:21:47: bzr took 0 seconds to add+commit
2006-03-01 10:21:47: afbinit_1.0-1.1.dsc
2006-03-01 10:21:48: bzr took 1 seconds to add+commit
2006-03-01 10:21:48: amoeba_1.1-13.dsc
2006-03-01 10:21:49: bzr took 1 seconds to add+commit
2006-03-01 10:21:49: amoeba_1.1-16.dsc
2006-03-01 10:21:50: bzr took 1 seconds to add+commit
2006-03-01 10:21:50: ant_1.6.2-2.dsc
2006-03-01 10:22:02: bzr took 11 seconds to add+commit
2006-03-01 10:22:02: apple2_0.7.4-3.2.dsc
2006-03-01 10:22:06: bzr took 4 seconds to add+commit
2006-03-01 10:22:06: apple2_0.7.4-3.1.dsc
2006-03-01 10:22:10: bzr took 3 seconds to add+commit
2006-03-01 10:22:10: arbortext-catalog_1.01-3.2.dsc
2006-03-01 10:22:14: bzr took 4 seconds to add+commit
2006-03-01 10:22:14: argouml_0.19.6-2.dsc
2006-03-01 10:22:30: bzr took 16 seconds to add+commit
2006-03-01 10:22:30: asm_1.5.2-1.dsc
2006-03-01 10:22:38: bzr took 8 seconds to add+commit
2006-03-01 10:22:38: aspectj_1.1.1-1.dsc
2006-03-01 10:22:47: bzr took 9 seconds to add+commit
2006-03-01 10:22:47: aspectj_1.1.1-1.1.dsc
2006-03-01 10:22:54: bzr took 7 seconds to add+commit
2006-03-01 10:22:54: at76c503a_0.12.beta19-4.dsc
2006-03-01 10:23:01: bzr took 7 seconds to add+commit
2006-03-01 10:23:01: at76c503a_0.12.beta23-4.dsc
2006-03-01 10:23:08: bzr took 7 seconds to add+commit
2006-03-01 10:23:08: atari800_1.3.2-1.1.dsc
2006-03-01 10:23:17: bzr took 8 seconds to add+commit
2006-03-01 10:23:17: atari800_1.3.2-1.dsc
2006-03-01 10:23:24: bzr took 7 seconds to add+commit
2006-03-01 10:23:24: atokx_1.0-16.dsc
2006-03-01 10:23:32: bzr took 7 seconds to add+commit
2006-03-01 10:23:32: atokx2_17.0-2.0-1.dsc
2006-03-01 10:23:39: bzr took 7 seconds to add+commit
2006-03-01 10:23:39: atokx2_17.0-2.0-4.dsc
2006-03-01 10:23:46: bzr took 7 seconds to add+commit
2006-03-01 10:23:46: autorespond_2.0.5-1.dsc
2006-03-01 10:23:53: bzr took 7 seconds to add+commit
2006-03-01 10:23:53: avalon-framework_4.1.2-2.1.dsc
2006-03-01 10:24:03: bzr took 10 seconds to add+commit
2006-03-01 10:24:03: azureus_2.2.0.2-1.dsc
2006-03-01 10:24:22: bzr took 19 seconds to add+commit
2006-03-01 10:24:22: azureus_2.3.0.6-2.dsc
2006-03-01 10:24:46: bzr took 24 seconds to add+commit
2006-03-01 10:24:46: azureus_2.3.0.6-3.dsc
2006-03-01 10:25:03: bzr took 16 seconds to add+commit
2006-03-01 10:25:03: babel_0.10.2-1.dsc
2006-03-01 10:25:36: bzr took 32 seconds to add+commit
2006-03-01 10:25:36: babel_0.10.2-2.1.dsc
2006-03-01 10:25:57: bzr took 20 seconds to add+commit
2006-03-01 10:25:57: basilisk2_0.9.20030722-2.dsc
2006-03-01 10:26:15: bzr took 17 seconds to add+commit
2006-03-01 10:26:15: basilisk2_0.9.20050730-1.dsc
2006-03-01 10:26:40: bzr took 24 seconds to add+commit
2006-03-01 10:26:40: batik_1.5.1-1.dsc
2006-03-01 10:27:12: bzr took 31 seconds to add+commit
2006-03-01 10:27:12: batik_1.6-2.dsc
2006-03-01 10:27:57: bzr took 44 seconds to add+commit
2006-03-01 10:27:57: bsh_1.3.0-3.dsc
2006-03-01 10:28:20: bzr took 23 seconds to add+commit
2006-03-01 10:28:20: btools_1.1-5.dsc
2006-03-01 10:28:42: bzr took 22 seconds to add+commit
2006-03-01 10:28:42: bouncycastle_1.30-1.dsc
2006-03-01 10:29:15: bzr took 33 seconds to add+commit
2006-03-01 10:29:15: bcm43xx-fwcutter_20060108-3.dsc
2006-03-01 10:29:39: bzr took 23 seconds to add+commit
2006-03-01 10:29:39: bcm43xx-fwcutter_20060108-5.dsc
2006-03-01 10:30:03: bzr took 24 seconds to add+commit
2006-03-01 10:30:03: bcm43xx_20060125-2.dsc
2006-03-01 10:30:26: bzr took 23 seconds to add+commit
2006-03-01 10:30:26: bcm43xx_20060212-3.dsc
2006-03-01 10:30:52: bzr took 25 seconds to add+commit
2006-03-01 10:30:52: cbedic_4.0-2.dsc
2006-03-01 10:31:15: bzr took 23 seconds to add+commit
2006-03-01 10:31:15: ccc_6.5.9.001-3.dsc
2006-03-01 10:31:38: bzr took 23 seconds to add+commit
2006-03-01 10:31:38: cfal_1.2.0-3.dsc
2006-03-01 10:32:01: bzr took 23 seconds to add+commit
2006-03-01 10:32:01: cfalrtl_1.2.0-3.dsc
2006-03-01 10:32:25: bzr took 24 seconds to add+commit
2006-03-01 10:32:25: cl-geodesics_20010214-7.dsc
2006-03-01 10:32:48: bzr took 23 seconds to add+commit
2006-03-01 10:32:48: cl-umlisp-orf_3.3.0-1.dsc
2006-03-01 10:33:12: bzr took 23 seconds to add+commit
2006-03-01 10:33:12: cl-umlisp-orf_3.3.0-2.dsc
2006-03-01 10:33:35: bzr took 23 seconds to add+commit
2006-03-01 10:33:35: cl-umlisp_4.1.0-1.dsc
2006-03-01 10:33:59: bzr took 24 seconds to add+commit
2006-03-01 10:33:59: cl-umlisp_4.1.0-2.dsc
2006-03-01 10:34:23: bzr took 24 seconds to add+commit
2006-03-01 10:34:23: classworlds_1.0.1-1.1.dsc
2006-03-01 10:34:47: bzr took 24 seconds to add+commit
2006-03-01 10:34:47: cltl_1.0.15.dsc
2006-03-01 10:35:10: bzr took 23 seconds to add+commit
2006-03-01 10:35:10: cltl_1.0.19.dsc
2006-03-01 10:35:34: bzr took 24 seconds to add+commit
2006-03-01 10:35:34: commons-httpclient_2.0a1+20020904-2.dsc
2006-03-01 10:35:58: bzr took 24 seconds to add+commit
2006-03-01 10:35:58: cpml_5.2.0-1.dsc
2006-03-01 10:36:22: bzr took 24 seconds to add+commit
2006-03-01 10:36:22: crafty-books-medium_1.0-2.dsc
2006-03-01 10:36:55: bzr took 32 seconds to add+commit
2006-03-01 10:36:55: crafty-books-medtosmall_1.0-2.dsc
2006-03-01 10:37:20: bzr took 25 seconds to add+commit
2006-03-01 10:37:20: crafty-books-small_1.0-2.dsc
2006-03-01 10:37:45: bzr took 24 seconds to add+commit
2006-03-01 10:37:45: cxml_5.2.0-1.dsc
2006-03-01 10:38:10: bzr took 25 seconds to add+commit
2006-03-01 10:38:10: dguitar_0.5.5-1.dsc
2006-03-01 10:38:36: bzr took 25 seconds to add+commit
2006-03-01 10:38:36: daemontools-installer_0.76-9.dsc
2006-03-01 10:39:02: bzr took 25 seconds to add+commit
2006-03-01 10:39:02: djbdns-installer_1.05-11.dsc
2006-03-01 10:39:26: bzr took 24 seconds to add+commit
2006-03-01 10:39:26: dosemu-freedos_b8p-4.dsc
2006-03-01 10:39:57: bzr took 30 seconds to add+commit
2006-03-01 10:39:57: dosemu-freedos_0.0.b9r5a-1.dsc
2006-03-01 10:40:40: bzr took 42 seconds to add+commit
2006-03-01 10:40:40: dosemu-freedos_0.0.b9r5a-2.dsc
2006-03-01 10:41:15: bzr took 34 seconds to add+commit
2006-03-01 10:41:15: dosemu_1.2.2-2.dsc
2006-03-01 10:41:51: bzr took 36 seconds to add+commit
2006-03-01 10:41:51: dosemu_1.2.1-3.dsc
2006-03-01 10:42:30: bzr took 38 seconds to add+commit
2006-03-01 10:42:30: dresden-ocl_1.1-8.dsc
2006-03-01 10:43:05: bzr took 34 seconds to add+commit
2006-03-01 10:43:05: eclipse-nls-sdk_2.1.2.1-2.dsc
2006-03-01 10:43:38: bzr took 32 seconds to add+commit
2006-03-01 10:43:38: em8300_0.14.0-2.dsc
2006-03-01 10:44:10: bzr took 32 seconds to add+commit
2006-03-01 10:44:10: em8300_0.15.1.dfsg-1.dsc
2006-03-01 10:44:45: bzr took 34 seconds to add+commit
2006-03-01 10:44:45: esix_1-2.dsc
2006-03-01 10:45:17: bzr took 31 seconds to add+commit
2006-03-01 10:45:17: exult_1.2-6.1.dsc
2006-03-01 10:45:53: bzr took 36 seconds to add+commit
2006-03-01 10:45:53: exult_1.2-4.dsc
2006-03-01 10:46:35: bzr took 41 seconds to add+commit
2006-03-01 10:46:35: exult_1.2-6.dsc
2006-03-01 10:47:17: bzr took 41 seconds to add+commit
2006-03-01 10:47:17: f-prot-installer_0.5.14.sarge.1.dsc
2006-03-01 10:47:51: bzr took 34 seconds to add+commit
2006-03-01 10:47:51: f-prot-installer_0.5.21.dsc
2006-03-01 10:48:24: bzr took 33 seconds to add+commit
2006-03-01 10:48:24: festalon_0.2.4-1.dsc
2006-03-01 10:48:58: bzr took 34 seconds to add+commit
2006-03-01 10:48:58: festvox-don_1.4.0-4.dsc
2006-03-01 10:49:32: bzr took 33 seconds to add+commit
2006-03-01 10:49:32: festvox-rablpc16k_1.4.0-2.dsc
2006-03-01 10:50:06: bzr took 34 seconds to add+commit
2006-03-01 10:50:06: festvox-rablpc8k_1.4.0-2.dsc
2006-03-01 10:50:39: bzr took 33 seconds to add+commit
2006-03-01 10:50:39: filler_1.02-3.dsc
2006-03-01 10:51:14: bzr took 35 seconds to add+commit
2006-03-01 10:51:14: flashplugin-nonfree_7.0.25-5.dsc
2006-03-01 10:51:48: bzr took 34 seconds to add+commit
2006-03-01 10:51:48: flashplugin-nonfree_7.0.61-1.2.dsc
2006-03-01 10:52:21: bzr took 33 seconds to add+commit
2006-03-01 10:52:21: fop_0.20.5-5.dsc
2006-03-01 10:52:59: bzr took 37 seconds to add+commit
2006-03-01 10:53:00: fop_0.20.5-8.dsc
2006-03-01 10:53:36: bzr took 36 seconds to add+commit
2006-03-01 10:53:36: forrest_0.5.1-4.dsc
2006-03-01 10:54:15: bzr took 39 seconds to add+commit
2006-03-01 10:54:15: freeguide_0.8.5-1.dsc
2006-03-01 10:54:52: bzr took 36 seconds to add+commit
2006-03-01 10:54:52: freeguide_0.8.6-1.dsc
2006-03-01 10:55:29: bzr took 36 seconds to add+commit
2006-03-01 10:55:29: freemind_0.7.1-6.dsc
2006-03-01 10:56:06: bzr took 37 seconds to add+commit
2006-03-01 10:56:06: gkrelldnet_0.14.2-6.dsc
2006-03-01 10:56:43: bzr took 37 seconds to add+commit
2006-03-01 10:56:43: gngeo_0.6.4-2.dsc
2006-03-01 10:57:21: bzr took 38 seconds to add+commit
2006-03-01 10:57:21: gngeo_0.6.7-1.dsc
2006-03-01 10:58:05: bzr took 44 seconds to add+commit
2006-03-01 10:58:05: gngeogui_0.1-2.dsc
2006-03-01 10:58:42: bzr took 37 seconds to add+commit
2006-03-01 10:58:42: gnuboy_1.0.3-2.1.dsc
2006-03-01 10:59:19: bzr took 37 seconds to add+commit
2006-03-01 10:59:19: gnuboy_1.0.3-1.dsc
2006-03-01 10:59:57: bzr took 37 seconds to add+commit
2006-03-01 10:59:57: gnuvd_1.0.3-1.dsc
2006-03-01 11:00:34: bzr took 37 seconds to add+commit
2006-03-01 11:00:34: gnuvd_1.0-1.dsc
2006-03-01 11:01:14: bzr took 40 seconds to add+commit
2006-03-01 11:01:14: gr-usrp_0.6-1.dsc
2006-03-01 11:01:52: bzr took 38 seconds to add+commit
2006-03-01 11:01:52: groovy_0.1.0beta10-2.dsc
2006-03-01 11:02:38: bzr took 45 seconds to add+commit
2006-03-01 11:02:38: groovy_0.1.0beta10-3.dsc
2006-03-01 11:03:20: bzr took 41 seconds to add+commit
2006-03-01 11:03:21: gsnes9x_3.12-8.dsc
2006-03-01 11:04:01: bzr took 40 seconds to add+commit
2006-03-01 11:04:01: gtktrain_0.9b-9.1.dsc
2006-03-01 11:04:41: bzr took 40 seconds to add+commit
2006-03-01 11:04:41: gtktrain_0.9b-9.dsc
2006-03-01 11:05:20: bzr took 39 seconds to add+commit
2006-03-01 11:05:20: gwp_0.3.6-1.dsc
2006-03-01 11:06:03: bzr took 42 seconds to add+commit
2006-03-01 11:06:03: gwp_0.4.0-1.1.dsc
2006-03-01 11:07:00: bzr took 56 seconds to add+commit
2006-03-01 11:07:00: honyaku-el_1.02-7.dsc
2006-03-01 11:07:45: bzr took 44 seconds to add+commit
2006-03-01 11:07:45: hptalx_1.1.0-5.dsc
2006-03-01 11:08:25: bzr took 40 seconds to add+commit
2006-03-01 11:08:25: hyperspec_1.18.dsc
2006-03-01 11:09:05: bzr took 40 seconds to add+commit
2006-03-01 11:09:05: hyperspec_1.21.dsc
2006-03-01 11:09:49: bzr took 44 seconds to add+commit
2006-03-01 11:09:49: ida_2.01-1.3.dsc
2006-03-01 11:10:30: bzr took 40 seconds to add+commit
2006-03-01 11:10:30: ida_2.01-1.2.dsc
2006-03-01 11:11:10: bzr took 40 seconds to add+commit
2006-03-01 11:11:10: imgtex_0.20050123-4.dsc
2006-03-01 11:11:51: bzr took 41 seconds to add+commit
2006-03-01 11:11:51: int-fiction-installer_1.5.dsc
2006-03-01 11:12:31: bzr took 40 seconds to add+commit
2006-03-01 11:12:31: ipw2100_1.1.0-1.dsc
2006-03-01 11:13:13: bzr took 41 seconds to add+commit
2006-03-01 11:13:13: ipw2100_1.1.3-1.dsc
2006-03-01 11:13:58: bzr took 45 seconds to add+commit
2006-03-01 11:13:58: ipw2200_1.0.3-1.dsc
2006-03-01 11:14:40: bzr took 42 seconds to add+commit
2006-03-01 11:14:40: ipw2200_1.0.8-2.dsc
2006-03-01 11:15:26: bzr took 45 seconds to add+commit
2006-03-01 11:15:26: java-package_0.24.dsc
2006-03-01 11:16:07: bzr took 41 seconds to add+commit
2006-03-01 11:16:07: java-package_0.27.dsc
2006-03-01 11:16:47: bzr took 40 seconds to add+commit
2006-03-01 11:16:47: jde_2.3.5-1.1.dsc
2006-03-01 11:17:33: bzr took 45 seconds to add+commit
2006-03-01 11:17:34: jde_2.3.3-2.dsc
2006-03-01 11:18:26: bzr took 49 seconds to add+commit
2006-03-01 11:18:26: jetty_5.1.5rc1-6.dsc
2006-03-01 11:19:38: bzr took 71 seconds to add+commit
2006-03-01 11:19:38: jikes-contrib_0.8.dsc
2006-03-01 11:20:56: bzr took 76 seconds to add+commit
2006-03-01 11:20:56: jikes-contrib_0.9.dsc
2006-03-01 11:21:52: bzr took 56 seconds to add+commit
2006-03-01 11:21:52: jspwiki_2.0.52-12.dsc
2006-03-01 11:22:45: bzr took 51 seconds to add+commit
2006-03-01 11:22:45: jspwiki_2.2.33-1.dsc
2006-03-01 11:23:41: bzr took 55 seconds to add+commit
2006-03-01 11:23:41: jswat_1.7-2.dsc
2006-03-01 11:24:32: bzr took 50 seconds to add+commit
2006-03-01 11:24:32: jswat2_2.37-1.dsc
2006-03-01 11:26:00: bzr took 86 seconds to add+commit
2006-03-01 11:26:00: jta_2.5-1.dsc
2006-03-01 11:28:03: bzr took 121 seconds to add+commit
2006-03-01 11:28:04: junitperf_1.8-1.dsc
2006-03-01 11:30:39: bzr took 152 seconds to add+commit
2006-03-01 11:30:39: kbedic_4.0-8.dsc
2006-03-01 11:33:26: bzr took 166 seconds to add+commit
2006-03-01 11:33:26: kbedic_4.0-4.dsc
2006-03-01 11:36:13: bzr took 166 seconds to add+commit
2006-03-01 11:36:13: ksetisaver_0.3.3-0.1.dsc
2006-03-01 11:38:33: bzr took 139 seconds to add+commit
2006-03-01 11:38:33: ksocrat_3.2.1-1.dsc
2006-03-01 11:40:59: bzr took 145 seconds to add+commit
2006-03-01 11:40:59: kfolding_1.0.0-rc2-5.dsc
2006-03-01 11:44:25: bzr took 205 seconds to add+commit
2006-03-01 11:44:25: lgc-pg_0.32-2.dsc
2006-03-01 11:48:29: bzr took 242 seconds to add+commit
2006-03-01 11:48:29: lgeneral_1.1.1-4.dsc