Bazaar: Out of memory

[Guido Ostkamp]

On Fri, 9 May 2008, Ian Clatworthy wrote:
> James Westby wrote:
>> That's not a MemoryError, so it's a different problem. Ian made a typo 
>> when he suggested the code change
>
> Oops. :-(
>
> Another thing - please make sure you're importing from git using the 
> "two pass" approach, i.e. generating a config file the first time and 
> then passing that via the --info option to fast-import on the second 
> pass. This is covered in the online help from memory.

Ian, I tried the two pass approach this time. Phase #1 went well with low 
memory footprint.

Phase #2 crashed after a long time for a different reason (no memory error 
this time, the memory footprint seems to be below the one pass approach).

Below is the new crash reason. Any hints from your side?

15:20:16 Found 30000 commits already loaded - skipping over these ...
15:27:06 Generated the file-ids cache - 9599 entries
15:44:16 31000/41713 commits processed [0:08:19] (:61314)
16:00:37 32000/41713 commits processed [0:12:16] (:63289)
16:17:31 33000/41713 commits processed [0:15:08] (:65278)
16:34:38 34000/41713 commits processed [0:16:53] (:67201)
16:52:23 35000/41713 commits processed [0:17:41] (:69182)
17:10:19 36000/41713 commits processed [0:17:29] (:71181)
17:28:25 37000/41713 commits processed [0:16:20] (:73177)
17:46:40 38000/41713 commits processed [0:14:19] (:75149)
bzr: ERROR: exceptions.AttributeError: 'module' object has no attribute 'InventoryLnk'

Traceback (most recent call last):
   File "/home/ostkamp/local/lib/python2.5/site-packages/bzrlib/commands.py", line 846, in run_bzr_catch_errors
     return run_bzr(argv)
   File "/home/ostkamp/local/lib/python2.5/site-packages/bzrlib/commands.py", line 802, in run_bzr
     ret = run(*run_argv)
   File "/home/ostkamp/local/lib/python2.5/site-packages/bzrlib/commands.py", line 504, in run_argv_aliases
     return self.run(**all_cmd_args)
   File "/home/ostkamp/.bazaar/plugins/fastimport/__init__.py", line 161, in run
     params, verbose)
   File "/home/ostkamp/.bazaar/plugins/fastimport/__init__.py", line 50, in _run
     return proc.process(p.iter_commands)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processor.py", line 83, in process
     self._process(command_iter)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processors/generic_processor.py", line 227, in _process
     processor.ImportProcessor._process(self, command_iter)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processor.py", line 105, in _process
     handler(self, cmd)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processors/generic_processor.py", line 382, in commit_handler
     handler.process()
   File "/home/ostkamp/.bazaar/plugins/fastimport/processor.py", line 170, in process
     handler(self, fc)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processors/generic_processor.py", line 663, in modify_handler
     filecmd.is_executable, data)
   File "/home/ostkamp/.bazaar/plugins/fastimport/processors/generic_processor.py", line 799, in _modify_inventory
     elif isinstance(ie, inventory.InventoryLnk):
AttributeError: 'module' object has no attribute 'InventoryLnk'

bzr 1.4 on python 2.5.2 (linux2)
arguments: ['/home/ostkamp/local/bin/bzr', 'fast-import', 'xxx.fi', '--info', 'xxx.cfg']
encoding: 'UTF-8', fsenc: 'UTF-8', lang: 'en_US.UTF-8'
plugins:
   fastimport           /home/ostkamp/.bazaar/plugins/fastimport [unknown]
   launchpad            /home/ostkamp/local/lib/python2.5/site-packages/bzrlib/plugins/launchpad [unknown]
*** Bazaar has encountered an internal error.
     Please report a bug at https://bugs.launchpad.net/bzr/+filebug
     including this traceback, and a description of what you
     were doing when the error occurred.


Regards

Guido