[Bug 1983255] Re: samtools-legacy misses 'Remove compressBound assertions' (PR #1258) fix

[Steve Langasek]

Hello Frank, or anyone else affected,

Accepted samtools-legacy into jammy-proposed. The package will build now
and be available at https://launchpad.net/ubuntu/+source/samtools-
legacy/0.1.19+dfsg-5ubuntu0.1 in a few hours, and then in the -proposed
repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how
to enable and use -proposed.  Your feedback will aid us getting this
update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, what testing has been
performed on the package and change the tag from verification-needed-
jammy to verification-done-jammy. If it does not fix the bug for you,
please add a comment stating that, and change the tag to verification-
failed-jammy. In either case, without details of your testing we will
not be able to proceed.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance for helping!

N.B. The updated package will be released to -updates after the bug(s)
fixed by this package have been verified and the package has been in
-proposed for a minimum of 7 days.

** Changed in: samtools-legacy (Ubuntu Jammy)
       Status: In Progress => Fix Committed

** Tags added: verification-needed verification-needed-jammy

** Changed in: samtools-legacy (Ubuntu Focal)
       Status: In Progress => Fix Committed

** Tags added: verification-needed-focal

-- 
You received this bug notification because you are a member of Ubuntu
Sponsors Team, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1983255

Title:
  samtools-legacy misses 'Remove compressBound assertions' (PR #1258)
  fix

Status in libbio-samtools-perl package in Ubuntu:
  Fix Released
Status in samtools-legacy package in Ubuntu:
  Fix Released
Status in libbio-samtools-perl source package in Focal:
  New
Status in samtools-legacy source package in Focal:
  Fix Committed
Status in libbio-samtools-perl source package in Jammy:
  New
Status in samtools-legacy source package in Jammy:
  Fix Committed
Status in libbio-samtools-perl source package in Kinetic:
  Fix Released
Status in samtools-legacy source package in Kinetic:
  Fix Released

Bug description:
  SRU Justification:
  ==================

  [Impact]

   * zlib requires a fix for 'compressBound() returns an incorrect result
     on z15' (described at LP#1961427 in more detail).

   * But the above patch expects that another fix 'Remove compressBound
     assertions' (PR #1258) is in place for all bgzf.c implementations.

   * The packages htslib and bedtools are covered in LP#1961427.

   * Unfortunately more 'embedded' or better 'bundled' bgzf.c implementations
     exist, that are difficult to find upfront, hence the zlib proposed migration
     now pointed to libbio-samtools-perl.

   * libbio-samtools-perl is linked to libbam-dev from samtools-legacy;
     and samtools-legacy contains another bgzf.c implementation.

   * Hence PR #1258 is needed to fix bgzf.c as part of samtools-legacy.

   * And libbio-samtools-perl needs then rebuild to like against the
     fixed libbam-dev.

   * PR #1258 removes the Assert lines and modifies bgzf_compress.

  [Test Plan]

  * An IBM zSystem (LPAR, z/VM guest or KVM virtual machine)
    with Ubuntu Server 20.04 (or 22.04 or 22.10).

  * Having the zlib version from -proposed installed or from PPA:
    ppa:fheimes/lp1961427

  * The easiest way to test this is based on the autopkgtest of the affected
    package, here 'samtools-legacy' (here a manual autopkgtest execution):
        autopkgtest --no-built-binaries --apt-pocket=proposed --apt-upgrade \
        --shell-fail --setup-commands="apt -y -q install \
        software-properties-common; apt-key adv --keyserver \
        hkp://keyserver.ubuntu.com:80 --recv-keys \
        73E9E91F16C43C45C621AE3EDF0A28DEFAFEB468; add-apt-repository -y \
        ppa:fheimes/lp1983255; apt update; apt -y upgrade; apt install -y \
        libbam-dev=0.1.19+dfsg-5ubuntu1" samtools-legacy_0.1.19+dfsg-5ubuntu1.dsc \
        -- lxd autopkgtest/ubuntu/kinetic/s390x
        (for focal and jammy adjust the versions accordingly)

   * Without PR #1258 in place, the error: 'bgzf.c:<line-number>: bgzf_open:
     Assertion `compressBound(BGZF_BLOCK_SIZE) < BGZF_MAX_BLOCK_SIZE'
     will occur.

   * If the above test is successful one can rebuild 'libbio-samtools-perl',
     and run the autopkgtest of 'libbio-samtools-perl' on top.

  [Where problems could occur]

   * The bgzf.c implementation as it is in 'samtools-legacy' is very outdated
     and the code was not touched for close to 10 years.

   * Hence PR #1258 could not directly be applied, and a backport was
  needed.

   * Issues could be that checks (due to missing asserts) are now
  insufficient,

   * or (un-)compress does not work properly anymore, due to the changes in
     bgzf_compress.

   * But the autopkgtest(s) will be helpful to ensure proper
  functionality.

  [Other Info]

   * The different bgzf.c versions that are bundled are almost all
     slightly different implementations, hence the backport of PR #1258
     needs to be a bit adjusted here and there.
  __________

  samtools-legacy is the source package for libbam-dev,
  which is used by libbio-samtools-perl (autopkgtests),
  that is for example triggered by a zlib update (proposed-transition).

  zlib requires a fix for 'compressBound() returns an incorrect result
  on z15' LP#1961427 that again requires the 'Remove compressBound
  assertions' (PR #1258) fix in all bgzf.c implementations, like htslib,
  bedtools or even samtools-legacy.

  Problematic is that the code differs quite a bit from the one where
  the PR#1258 was designed for and that is used in the htslib or
  bedtools package (no bgzf_hopen - looks a bit out of date), so it does
  not apply cleanly.

  According to upstream 'https://github.com/lh3/samtools-legacy' the project
  is "For testing only." and marked as "DON'T USE!" and it's last update
  is from Nov 9, 2013.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/libbio-samtools-perl/+bug/1983255/+subscriptions