[Bug 1944906] Re: MagicProxy broken when repo-snapshot-stamp is used

[Thomas Bechtold]

** Changed in: livecd-rootfs (Ubuntu)
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to livecd-rootfs in Ubuntu.
https://bugs.launchpad.net/bugs/1944906

Title:
  MagicProxy broken when repo-snapshot-stamp is used

Status in livecd-rootfs package in Ubuntu:
  Fix Released

Bug description:
  The CPC team wants to reenable the repo-snapshot-stamp feature in magic proxy to get similar package sets when building multiple images. But that is currently broken.
  When building in launchpad with something like:

  RUN: /usr/share/launchpad-buildd/bin/in-target buildlivefs
  --backend=lxd --series=impish --arch=arm64 LIVEFSBUILD-299827
  --project ubuntu-cpc --datestamp 20210924 --image-format ext4 --image-
  target disk-image --image-target kvm --image-target qcow2 --image-
  target squashfs --image-target tarball --image-target vagrant --image-
  target vmdk --image-target azure --image-target azure-pro --image-
  target hyperv-gcs --image-target wsl --repo-snapshot-stamp 1632467595
  --cohort-key
  MSAqIDE2MzI0Njc4OTcgMTVjNTk1ZWQ1NjFlMjM5OWEzNmQ5ZTE0MDlmZjlmMDdiOGNhM2JlMGI0N2UyMzBjZGVjMGUzOWEyNjk0NTA1Mw==

  
  the build fails with:

  REDIRECT  tcp opt -- in * out *  0.0.0.0/0  -> 0.0.0.0/0   tcp dpt:80 ! owner UID match 1 redir ports 8080
  add password for /cloudware/cpc-livecd-rootfs/ubuntu
  Ign:1 http://ftpmaster.internal/ubuntu impish InRelease
  Ign:2 http://ftpmaster.internal/ubuntu impish-security InRelease
  Ign:3 http://ftpmaster.internal/ubuntu impish-updates InRelease
  Ign:4 http://private-ppa.buildd/cloudware/cpc-livecd-rootfs/ubuntu impish InRelease
  Ign:1 http://ftpmaster.internal/ubuntu impish InRelease
  Ign:2 http://ftpmaster.internal/ubuntu impish-security InRelease
  Ign:3 http://ftpmaster.internal/ubuntu impish-updates InRelease
  Ign:4 http://private-ppa.buildd/cloudware/cpc-livecd-rootfs/ubuntu impish InRelease
  Ign:1 http://ftpmaster.internal/ubuntu impish InRelease
  Ign:2 http://ftpmaster.internal/ubuntu impish-security InRelease
  Ign:3 http://ftpmaster.internal/ubuntu impish-updates InRelease
  Ign:4 http://private-ppa.buildd/cloudware/cpc-livecd-rootfs/ubuntu impish InRelease
  Err:1 http://ftpmaster.internal/ubuntu impish InRelease
    Connection failed [IP: 10.189.129.95 80]
  Err:2 http://ftpmaster.internal/ubuntu impish-security InRelease
    Connection failed [IP: 10.189.129.95 80]
  Err:3 http://ftpmaster.internal/ubuntu impish-updates InRelease
    Connection failed [IP: 10.189.129.95 80]
  Err:4 http://private-ppa.buildd/cloudware/cpc-livecd-rootfs/ubuntu impish InRelease
    Connection failed [IP: 91.189.95.85 80]
  Reading package lists...
  W: Failed to fetch http://private-ppa.buildd/cloudware/cpc-livecd-rootfs/ubuntu/dists/impish/InRelease  Connection failed [IP: 91.189.95.85 80]
  W: Failed to fetch http://ftpmaster.internal/ubuntu/dists/impish/InRelease  Connection failed [IP: 10.189.129.95 80]
  W: Failed to fetch http://ftpmaster.internal/ubuntu/dists/impish-security/InRelease  Connection failed [IP: 10.189.129.95 80]
  W: Failed to fetch http://ftpmaster.internal/ubuntu/dists/impish-updates/InRelease  Connection failed [IP: 10.189.129.95 80]
  W: Some index files failed to download. They have been ignored, or old ones used instead.
  P: Setting up cleanup function
  [2021-09-24 07:23:31] lb_bootstrap 
  P: Setting up cleanup function
  [2021-09-24 07:23:31] lb_bootstrap_cache restore
  P: Restoring bootstrap stage from cache...
  [2021-09-24 07:23:31] lb_bootstrap_copy 
  [2021-09-24 07:23:32] lb_bootstrap_cdebootstrap 
  [2021-09-24 07:23:32] lb_bootstrap_debootstrap 
  P: Begin bootstrapping system...
  [2021-09-24 07:23:32] lb_testroot 
  P: If the following stage fails, the most likely cause of the problem is with your mirror configuration or a caching proxy.
  P: Running debootstrap (download-only)... 
  I: Retrieving InRelease 
  I: Retrieving Release 
  E: Failed getting release file http://ftpmaster.internal/ubuntu/dists/impish/Release
  P: Begin unmounting filesystems...
  P: Saving caches...
  ================= Magic proxy log (start) =================
  ----------------------------------------
  Exception occurred during processing of request from ('10.10.10.2', 39554)
  Traceback (most recent call last):
    File "/usr/lib/python3.9/socketserver.py", line 683, in process_request_thread
      self.finish_request(request, client_address)
    File "/usr/lib/python3.9/socketserver.py", line 360, in finish_request
      self.RequestHandlerClass(request, client_address, self)
    File "/usr/lib/python3.9/socketserver.py", line 747, in __init__
      self.handle()
    File "/usr/lib/python3.9/http/server.py", line 427, in handle
      self.handle_one_request()
    File "/usr/lib/python3.9/http/server.py", line 415, in handle_one_request
      method()
    File "/usr/share/livecd-rootfs/magic-proxy", line 787, in do_GET
      self.__get_request()
    File "/usr/share/livecd-rootfs/magic-proxy", line 829, in __get_request
      mirror = get_uri(parsed.hostname, m.group("base"))
    File "/usr/share/livecd-rootfs/magic-proxy", line 84, in get_uri
      return "http://" + host + path
  TypeError: can only concatenate str (not "NoneType") to str

  
  See attached build log (from https://i559944962.restricted.launchpadlibrarian.net/559944962/buildlog_ubuntu_impish_arm64_arm64-disk-image_kvm_qcow2_squashfs_tarball_vagrant_vmdk_azure_azure-pro_hyperv-gcs_wsl_cpc-development_BUILDING.txt.gz?token=8pdlp0RtcWhsl3N1tdd0GhtdhDwWt4hd )

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/livecd-rootfs/+bug/1944906/+subscriptions