[Bug 1453330] Re: rewrite pull-[lp|debian|uca]-source

[Dan Streetman]

** Description changed:

  I've essentially re-written the pull-[lp|debian|uca]-source scripts,
  consolidating them all to use a common codebase and extending the
  functionality to allow pulling not only source but also debs, udebs, and
  ddebs.
  
  The updates also allow specifying binary package names, which the
  original pull-*-source didn't work with.
  
  The pull-lp-[debs|udebs|ddebs] also allows downloading otherwise "gone"
  debs from Launchpad - for older packages where LP no longer lists the
  binaries as existing anymore.  They are actually still there, but
  getting their specific URL is tricky, and not possible from the normal
  LP web interface.  The new pull-lp-* scripts can handle it and will
  allow downloading any deb/udeb/ddeb for any older package.
  
  This also fixes bug 1700846, where pull-debian-source fails for older
  packages where the public key that the DSC was signed with no longer is
  in the keyring.
  
  This also allows actually getting ddebs for old packages - unlike
  ddebs.ubuntu.com, which only provides ddebs for the latest few package
  versions, pull-lp-ddebs will actually pull ddebs for all older package
  versions, meaning you can debug a problem without being forced to
  upgrade to the latest version of all relevant packages first.
  
+ This also fixes various flake8/pylint failures when building in bionic.
+ The current version (without my patches) no longer builds in bionic due
+ to updates to flake8 and pylint causing ubuntu-dev-tools build failures.
+ 
  
  Original description:
  
  Errors like the following are happening because Debian's DDE [1] is dead
  [2]:
  
  logan at logan-VMware:~$ pull-debian-source d-rats
  pull-debian-source: Error: Unable to retrieve package information from DDE: http://dde.debian.net/dde/q/udd/dist/d:debian/r:sid/p:d-rats/?t=json (<urlopen error [Errno -2] Name or service not known>)
  pull-debian-source: Error: Unable to find d-rats in Debian suite "sid".
  
  Maybe someone would be willing to host/maintain a new instance of DDE?
  Or is there another way to programmatically grab the Debian/Ubuntu
  source package name from the binary package name?
  
  [1] https://wiki.debian.org/DDE
  [2] https://lists.debian.org/debian-devel/2014/09/msg00603.html
  
  Related bugs:
   * bug 1508948:  pull-debian-source fails use of rmadison on wily

-- 
You received this bug notification because you are a member of Ubuntu
Sponsors Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1453330

Title:
  rewrite pull-[lp|debian|uca]-source

Status in ubuntu-dev-tools package in Ubuntu:
  Triaged
Status in ubuntu-dev-tools package in Debian:
  New

Bug description:
  I've essentially re-written the pull-[lp|debian|uca]-source scripts,
  consolidating them all to use a common codebase and extending the
  functionality to allow pulling not only source but also debs, udebs,
  and ddebs.

  The updates also allow specifying binary package names, which the
  original pull-*-source didn't work with.

  The pull-lp-[debs|udebs|ddebs] also allows downloading otherwise
  "gone" debs from Launchpad - for older packages where LP no longer
  lists the binaries as existing anymore.  They are actually still
  there, but getting their specific URL is tricky, and not possible from
  the normal LP web interface.  The new pull-lp-* scripts can handle it
  and will allow downloading any deb/udeb/ddeb for any older package.

  This also fixes bug 1700846, where pull-debian-source fails for older
  packages where the public key that the DSC was signed with no longer
  is in the keyring.

  This also allows actually getting ddebs for old packages - unlike
  ddebs.ubuntu.com, which only provides ddebs for the latest few package
  versions, pull-lp-ddebs will actually pull ddebs for all older package
  versions, meaning you can debug a problem without being forced to
  upgrade to the latest version of all relevant packages first.

  This also fixes various flake8/pylint failures when building in
  bionic.  The current version (without my patches) no longer builds in
  bionic due to updates to flake8 and pylint causing ubuntu-dev-tools
  build failures.

  
  Original description:

  Errors like the following are happening because Debian's DDE [1] is
  dead [2]:

  logan at logan-VMware:~$ pull-debian-source d-rats
  pull-debian-source: Error: Unable to retrieve package information from DDE: http://dde.debian.net/dde/q/udd/dist/d:debian/r:sid/p:d-rats/?t=json (<urlopen error [Errno -2] Name or service not known>)
  pull-debian-source: Error: Unable to find d-rats in Debian suite "sid".

  Maybe someone would be willing to host/maintain a new instance of DDE?
  Or is there another way to programmatically grab the Debian/Ubuntu
  source package name from the binary package name?

  [1] https://wiki.debian.org/DDE
  [2] https://lists.debian.org/debian-devel/2014/09/msg00603.html

  Related bugs:
   * bug 1508948:  pull-debian-source fails use of rmadison on wily

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-dev-tools/+bug/1453330/+subscriptions