bzr struggling with large trees
Rob Holland
rob at inversepath.com
Sun Oct 16 23:05:55 BST 2005
Hi,
I've tried importing a tree with around 79,000 files total. The import
didn't go too badly, but the add/commit times are really painful.
tigger at xahn % echo > testing-bzr2
tigger at xahn % bzr --profile add testing-bzr2
added testing-bzr2
5129837 function calls (4790586 primitive calls) in 8.295 CPU seconds
Ordered by: cumulative time
List reduced from 182 to 20 due to restriction <20>
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.000 0.000 8.295 8.295 commands.py:258(run_argv)
1 0.000 0.000 8.295 8.295 builtins.py:184(run)
1 0.366 0.366 8.295 8.295 add.py:60(smart_add)
1 0.002 0.002 7.928 7.928 add.py:73(smart_add_branch)
2 0.000 0.000 3.820 1.910 branch.py:536(read_working_inventory)
2 0.093 0.047 3.819 1.910 xml.py:54(read_inventory)
2 0.362 0.181 3.726 1.863 xml5.py:105(_unpack_inventory)
1 0.000 0.000 3.577 3.577 branch.py:548(_write_inventory)
1 0.000 0.000 3.576 3.576 xml.py:43(write_inventory)
197884 1.195 0.000 3.079 0.000 xml5.py:124(_unpack_entry)
1 0.000 0.000 2.655 2.655 xml.py:69(_write_element)
1 0.000 0.000 2.655 2.655 ElementTree.py:652(write)
98944/1 0.748 0.000 2.655 2.655 ElementTree.py:662(_write)
1 0.000 0.000 2.588 2.588 branch.py:1055(working_tree)
296681 1.080 0.000 1.462 0.000 ElementTree.py:812(_escape_attrib)
158059 0.594 0.000 1.126 0.000 inventory.py:526(__init__)
1 0.109 0.109 0.921 0.921 xml5.py:36(_pack_inventory)
197885 0.660 0.000 0.660 0.000 inventory.py:219(__init__)
39826 0.525 0.000 0.654 0.000 inventory.py:443(__init__)
339247/98944 0.481 0.000 0.629 0.000 inventory.py:749(iter_entries)
tigger at xahn % bzr --profile commit -m "another test" testing-bzr2
20134289 function calls (18783355 primitive calls) in 41.949 CPU seconds
Ordered by: cumulative time
List reduced from 339 to 20 due to restriction <20>
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.000 0.000 41.949 41.949 commands.py:258(run_argv)
1 0.000 0.000 41.949 41.949 builtins.py:996(run)
1 0.691 0.691 41.947 41.947 branch.py:1017(commit)
1 0.003 0.003 41.254 41.254 commit.py:154(commit)
1 0.449 0.449 12.527 12.527 commit.py:361(_populate_new_inv)
197912 0.449 0.000 9.521 0.000 __init__.py:935(debug)
197912 0.588 0.000 8.588 0.000 __init__.py:1055(_log)
1 0.752 0.752 8.394 8.394 commit.py:338(_store_snapshot)
3 0.565 0.188 7.574 2.525 xml5.py:105(_unpack_inventory)
1 0.033 0.033 6.746 6.746 commit.py:245(_record_inventory)
296827 3.187 0.000 6.580 0.000 xml5.py:124(_unpack_entry)
2 0.034 0.017 6.227 3.114 branch.py:837(get_inventory)
2 0.184 0.092 6.014 3.007 xml.py:51(read_inventory_from_string)
1 0.176 0.176 5.333 5.333 xml.py:48(write_inventory_to_string)
98945 0.108 0.000 5.134 0.000 weave.py:92(get_weave_or_empty)
98947 1.119 0.000 5.026 0.000 weave.py:75(get_weave)
197912 0.423 0.000 4.618 0.000 __init__.py:1070(handle)
Anything more I can do to help try and solve the performance issues, let
me know.
I can be found as "tigger^" on irc.freenode.org if that helps, I sit in
#bzr.
Cheers
--
Rob Holland Inverse Path Ltd
Chief R & D Engineer -----> <--------
<rob at inversepath.com> http://www.inversepath.com
0xD91B4729 5251 4FAC D684 8845 5604 E44F D65C 392F D91B 4729
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20051016/f88e4597/attachment.pgp
More information about the bazaar
mailing list