[Bug 717879] Re: germinate should not examine all components in PPAs

[Colin Watson]

I think it's clearer to move tag_files.append(tag_file) into the inner
loop anyway; tag_file_open always either raises an exception or returns
non-None, and this makes that clear.

I'll deal with this and Barry's other nits.  Thanks!

-- 
You received this bug notification because you are a member of Ubuntu
Sponsors Team, which is a direct subscriber.
https://bugs.launchpad.net/bugs/717879

Title:
  germinate should not examine all components in PPAs

Status in “germinate” package in Ubuntu:
  Triaged

Bug description:
  Binary package hint: germinate

  Given the recent change to launchpad, specifically:

  https://lists.launchpad.net/launchpad-users/msg06219.html

  PPAs no longer contain all components.

  As such when updating the linaro-meta pkg with

  germinate-update-metapackage --bzr

  with an update.cfg as follows :
  --------------------
  [DEFAULT]
  dist: natty

  [natty]
  seeds: linaro-headless linaro-developement linaro-x11-base linaro-netbook-efl linaro-xfce-base linaro-alip linaro-graphical-engineering linaro-multimedia-engineering
  architectures: i386 amd64 armel powerpc

  seed_base: http://people.ubuntu.com/~ubuntu-archive/seeds/
  archive_base/default: http://archive.ubuntu.com/ubuntu/,http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/
  archive_base/ports: http://ports.ubuntu.com/ubuntu-ports/,http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/
  archive_base/armel: %(archive_base/ports)s
  archive_base/powerpc: %(archive_base/ports)s
  components: main universe

  [natty/bzr]
  seed_base: bzr+ssh://bazaar.launchpad.net/~linaro-maintainers/linaro-seeds/
  seed_dist: linaro.%(dist)s
  ---------

  Note the use of the linaro-maintainers/overlay ppa

  Because of the launchpad change this now fails with the following
  output:

  
  tgall at halimede:~/seeds-alip/linaro-meta-008$ germinate-update-metapackage --bzr       
  [info] Initialising linaro-* package lists update...
  [i386] Downloading available package lists...
  Downloading http://archive.ubuntu.com/ubuntu/dists/natty/main/binary-i386/Packages.bz2 file ...
  Decompressing http://archive.ubuntu.com/ubuntu/dists/natty/main/binary-i386/Packages.bz2 file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/binary-i386/Packages.bz2 file ...
  Decompressing http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/binary-i386/Packages.bz2 file ...
  Downloading http://archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources.bz2 file ...
  Decompressing http://archive.ubuntu.com/ubuntu/dists/natty/main/source/Sources.bz2 file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/source/Sources.bz2 file ...
  Decompressing http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/source/Sources.bz2 file ...
  Downloading http://archive.ubuntu.com/ubuntu/dists/natty/main/debian-installer/binary-i386/Packages.bz2 file ...
  Decompressing http://archive.ubuntu.com/ubuntu/dists/natty/main/debian-installer/binary-i386/Packages.bz2 file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/debian-installer/binary-i386/Packages.bz2 file ...
  Decompressing http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/main/debian-installer/binary-i386/Packages.bz2 file ...
  Downloading http://archive.ubuntu.com/ubuntu/dists/natty/universe/binary-i386/Packages.bz2 file ...
  Decompressing http://archive.ubuntu.com/ubuntu/dists/natty/universe/binary-i386/Packages.bz2 file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/universe/binary-i386/Packages.bz2 file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/universe/binary-i386/Packages.gz file ...
  Downloading http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/universe/binary-i386/Packages file ...
  Traceback (most recent call last):
    File "/usr/bin/germinate-update-metapackage", line 455, in <module>
      main()
    File "/usr/bin/germinate-update-metapackage", line 271, in main
      germinator, [dist], components, architecture, cleanup=True)
    File "/usr/lib/germinate/Germinate/Archive/tagfile.py", line 121, in feed
      "binary-" + arch + "/Packages"),
    File "/usr/lib/germinate/Germinate/Archive/tagfile.py", line 106, in open_tag_files
      tag_file = open_tag_file(mirror, "")
    File "/usr/lib/germinate/Germinate/Archive/tagfile.py", line 62, in open_tag_file
      url_f = urllib2.urlopen(req)
    File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
      return _opener.open(url, data, timeout)
    File "/usr/lib/python2.7/urllib2.py", line 398, in open
      response = meth(req, response)
    File "/usr/lib/python2.7/urllib2.py", line 511, in http_response
      'http', request, response, code, msg, hdrs)
    File "/usr/lib/python2.7/urllib2.py", line 436, in error
      return self._call_chain(*args)
    File "/usr/lib/python2.7/urllib2.py", line 370, in _call_chain
      result = func(*args)
    File "/usr/lib/python2.7/urllib2.py", line 519, in http_error_default
      raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
  urllib2.HTTPError: HTTP Error 404: Not Found

  
  The contents of  http://ppa.launchpad.net/linaro-maintainers/overlay/ubuntu/dists/natty/ no longer contains the universe directory just main. 

  Germinate needs to be changed to take this change in launchpad into
  account.