Borked repo?

[Anders Steinlein]

We have a shared repo on a centralized server that we push to for code  
reviews etc. "All of a sudden" pushing there stopped working, giving  
the following nasty exception:

bzr: ERROR: bzrlib.errors.ErrorFromSmartServer: Error received from  
smart server: ('error', "'NoneType' object has no attribute 'as_dict'")

Traceback (most recent call last):
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/commands.py", line 842, in  
exception_to_return_code
     return the_callable(*args, **kwargs)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/commands.py", line 1037, in run_bzr
     ret = run(*run_argv)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/commands.py", line 654, in  
run_argv_aliases
     return self.run(**all_cmd_args)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/builtins.py", line 1156, in run
     use_existing_dir=use_existing_dir)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/push.py", line 92, in  
_show_push_branch
     create_prefix=create_prefix, use_existing_dir=use_existing_dir)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/branch.py", line 1289, in  
create_clone_on_transport
     create_prefix=create_prefix, use_existing_dir=use_existing_dir)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/bzrdir.py", line 270, in  
clone_on_transport
     result_repo.fetch(local_repo, revision_id=revision_id)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/remote.py", line 1270, in fetch
     find_ghosts=find_ghosts, fetch_spec=fetch_spec)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/decorators.py", line 192, in  
write_locked
     result = unbound(self, *args, **kwargs)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/repository.py", line 3413, in fetch
     pb=pb, find_ghosts=find_ghosts)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/fetch.py", line 81, in __init__
     self.__fetch()
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/fetch.py", line 107, in __fetch
     self._fetch_everything_for_search(search)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/fetch.py", line 135, in  
_fetch_everything_for_search
     stream, from_format, [])
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/remote.py", line 1735, in  
insert_stream
     (verb, path, resume_tokens) + lock_args, byte_stream)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/smart/client.py", line 178, in  
call_with_body_stream
     expect_response_body=False)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/smart/client.py", line 78, in  
_call_and_read_response
     expect_body=expect_response_body),
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/smart/message.py", line 306, in  
read_response_tuple
     _translate_error(self.args)
   File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/ 
lib/python2.6/site-packages/bzrlib/smart/message.py", line 361, in  
_translate_error
     raise errors.ErrorFromSmartServer(error_tuple)
ErrorFromSmartServer: Error received from smart server: ('error',  
"'NoneType' object has no attribute 'as_dict'")

bzr 2.0.3 on python 2.6.4 (Darwin-9.8.0-i386-32bit)
arguments: ['/opt/local/bin/bzr', 'push', '--create-prefix', '--no- 
strict', 'bzr+ssh://adams.z-it.no/srv/bzr/apps/mailmojo/anders/scripts/ 
bouncemaster']
encoding: 'ascii', fsenc: 'utf-8', lang: 'en_US.UTF-8'
plugins:
   bzrtools             /opt/local/Library/Frameworks/Python.framework/ 
Versions/2.6/lib/python2.6/site-packages/bzrlib/plugins/bzrtools [2.0.1]
   diff_revid           /Users/anders/.bazaar/plugins/diff_revid  
[unknown]
   keywords             /Users/anders/.bazaar/plugins/keywords [unknown]
   launchpad            /opt/local/Library/Frameworks/Python.framework/ 
Versions/2.6/lib/python2.6/site-packages/bzrlib/plugins/launchpad  
[2.0.3]
   netrc_credential_store /opt/local/Library/Frameworks/ 
Python.framework/Versions/2.6/lib/python2.6/site-packages/bzrlib/ 
plugins/netrc_credential_store [2.0.3]
   rebase               /opt/local/Library/Frameworks/Python.framework/ 
Versions/2.6/lib/python2.6/site-packages/bzrlib/plugins/rebase [0.5.3]
   vimdiff              /Users/anders/.bazaar/plugins/vimdiff [unknown]


I logged into the server and did a bzr check on the root level of the  
shared repo, which also crashed:


hecking repository at 'file:///srv/bzr/apps/mailmojo/'.
checked repository <bzrlib.transport.local.LocalTransport url=file:///srv/bzr/apps/mailmojo/ 
 > format <RepositoryFormatKnitPack6RichRoot>
      0 revisions
      0 file-ids
      0 unique file texts
      0 repeated file texts
      0 unreferenced text versions
Checking branch at 'file:///srv/bzr/apps/mailmojo/anders/account/install-templates/' 
.
bzr: ERROR: exceptions.KeyError: 'anders at z-it.no-20100128092858-jshbywp2capoqe8p 
'

Traceback (most recent call last):
   File "/usr/lib/python2.6/dist-packages/bzrlib/commands.py", line  
716, in exception_to_return_code
     return the_callable(*args, **kwargs)
   File "/usr/lib/python2.6/dist-packages/bzrlib/commands.py", line  
911, in run_bzr
     ret = run(*run_argv)
   File "/usr/lib/python2.6/dist-packages/bzrlib/commands.py", line  
547, in run_argv_aliases
     return self.run(**all_cmd_args)
   File "/usr/lib/python2.6/dist-packages/bzrlib/builtins.py", line  
2867, in run
     check_dwim(path, verbose, do_branch=branch, do_repo=repo,  
do_tree=tree)
   File "/usr/lib/python2.6/dist-packages/bzrlib/check.py", line 317,  
in check_dwim
     check_branch(branch, verbose)
   File "/usr/lib/python2.6/dist-packages/bzrlib/check.py", line 272,  
in check_branch
     branch_result = branch.check()
   File "/usr/lib/python2.6/dist-packages/bzrlib/decorators.py", line  
138, in read_locked
     result = unbound(self, *args, **kwargs)
   File "/usr/lib/python2.6/dist-packages/bzrlib/branch.py", line  
1017, in check
     last_revision_id))
   File "/usr/lib/python2.6/dist-packages/bzrlib/repository.py", line  
1800, in iter_reverse_revision_history
     parents = graph.get_parent_map([next_id])[next_id]
KeyError: 'anders at z-it.no-20100128092858-jshbywp2capoqe8p'

bzr 1.13.1 on python 2.6.2 (linux2)
arguments: ['/usr/bin/bzr', 'check']
encoding: 'UTF-8', fsenc: 'UTF-8', lang: 'en_US.UTF-8'
plugins:
   bzrtools             /usr/lib/python2.6/dist-packages/bzrlib/ 
plugins/bzrtools [1.13]
   launchpad            /usr/lib/python2.6/dist-packages/bzrlib/ 
plugins/launchpad [unknown]
   netrc_credential_store /usr/lib/python2.6/dist-packages/bzrlib/ 
plugins/netrc_credential_store [unknown]
   rebase               /usr/lib/python2.6/dist-packages/bzrlib/ 
plugins/rebase [0.4.4]
   svn                  /usr/lib/python2.6/dist-packages/bzrlib/ 
plugins/svn [0.5.3]


I'm not sure if the server has had any software updates which might  
have caused this, or might there be more serious problems causing this?

-- anders.