[Bug 1311652] Re: Error during update

[Wei Mu]

I'm running a local mirror for my university and I've met the same problem.
I thought it was hard disk problem so it took me about a week before I finally figure out the reason.
I did a lot of test, read through RSYNC logs and contacted with upstream mirror.
I've come to the conclusion that it was caused by filesystem error in the upstream.

The interesting point here is that:
RSYNC CANNOT FIX CORRUPTED FILES if they have the SAME TIMESTAMP and SIZE but are wrong in content.

There are at least two ways to fix this problem.
* Manually download the corrupted files (most of them are .bz2 index files in my case) through http.
  However, there's no way you can figure out how many files have been damaged before. 
* Use rsync --checksum option to fix the whole archive.
  But as far as I know most mirror sites refuse -c option because of cpu consumption.
  I managed to fix the problem by rsync -c with official archive.ubuntu.com.
  Be aware, connection may be closed if too many files are being compared with checksum,
  so I wrote a script to rsync smaller sub-folders in traversal way:
ubuntu/dists/devel
ubuntu/dists/devel-backports
...
ubuntu/pool/main/a
ubuntu/pool/main/b
...
ubuntu/pool/universe/a
ubuntu/pool/universe/b
...
ubuntu/pool/multiverse/a
ubuntu/pool/multiverse/b
...
ubuntu/pool/restricted
ubuntu/indices

Hope this may help for mirror sites.

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to ubuntu-release-upgrader in
Ubuntu.
https://bugs.launchpad.net/bugs/1311652

Title:
  Error during update

Status in “ubuntu-release-upgrader” package in Ubuntu:
  Confirmed

Bug description:
  W:Failed to fetch gzip:/var/lib/apt/lists/partial/mirror.as29550.net_archive.ubuntu.com_dists_trusty_main_binary-i386_Packages  Hash Sum mismatch
  , W:Failed to fetch gzip:/var/lib/apt/lists/partial/mirror.as29550.net_archive.ubuntu.com_dists_trusty_universe_binary-i386_Packages  Hash Sum mismatch
  , E:Some index files failed to download. They have been ignored, or old ones used instead.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1311652/+subscriptions