[Bug 882832] Re: apt-get fails when fetching against s3 buckets

[Ben Howard]

After reaching out to Amazon, the base problem is how S3 interprets  the "+" symbol; S3 sees a "+" as a " ". The result is that S3 is sees a request of "foo+bar" not as "foo+bar" but as "foo bar". In order to get any file with a "+" in the name to work properly, you have to upload/copy the file three times to handle how different clients make the request::
- foo+bar: the original file name
- foo2%Bbar: for clients making character encoded requests
- foo bar:  for tools like wget, curl, etc

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to apt in Ubuntu.
https://bugs.launchpad.net/bugs/882832

Title:
  apt-get fails when fetching against s3 buckets

Status in “apt” package in Ubuntu:
  New

Bug description:
  apt-get is not capable of handling the quirkiness of S3 handling of
  URI:

  root at ip-10-119-1-14:/mirror# apt-get -y dist-upgrade
  Reading package lists... Done
  Building dependency tree
  Reading state information... Done
  Calculating upgrade... Done
  The following packages will be upgraded:
    binutils initramfs-tools initramfs-tools-bin libgssapi-krb5-2 libk5crypto3 libkrb5-3 libkrb5support0 libpam-modules libpam-modules-bin libpam-runtime libpam0g python-gobject python-gobject-cairo
    tzdata update-manager-core
  15 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
  Need to get 576 kB/4,697 kB of archives.
  After this operation, 0 B of additional disk space will be used.
  Err http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/ oneiric-updates/main libk5crypto3 amd64 1.9.1+dfsg-1ubuntu2.1
    403  Forbidden
  Err http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/ oneiric-updates/main libgssapi-krb5-2 amd64 1.9.1+dfsg-1ubuntu2.1
    403  Forbidden
  Err http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/ oneiric-updates/main libkrb5-3 amd64 1.9.1+dfsg-1ubuntu2.1
    403  Forbidden
  Err http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/ oneiric-updates/main libkrb5support0 amd64 1.9.1+dfsg-1ubuntu2.1
    403  Forbidden
  Failed to fetch http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/pool/main/k/krb5/libk5crypto3_1.9.1+dfsg-1ubuntu2.1_amd64.deb  403  Forbidden
  Failed to fetch http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/pool/main/k/krb5/libgssapi-krb5-2_1.9.1+dfsg-1ubuntu2.1_amd64.deb  403  Forbidden
  Failed to fetch http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/pool/main/k/krb5/libkrb5-3_1.9.1+dfsg-1ubuntu2.1_amd64.deb  403  Forbidden
  Failed to fetch http://<SOME BUCKET>.s3.amazonaws.com/ubuntu/pool/main/k/krb5/libkrb5support0_1.9.1+dfsg-1ubuntu2.1_amd64.deb  403  Forbidden

  In this case, apt is requesting libk5crypto3_1.9.1+dfsg-1ubuntu2.1_amd64.deb while S3 thinks that it should be
  liibk5crypto3_1.8.1%2Bdfsg-5ubuntu0.8_amd64.deb

  ProblemType: Bug
  DistroRelease: Ubuntu 11.10
  Package: apt 0.8.16~exp5ubuntu13
  ProcVersionSignature: Ubuntu 3.0.0-12.20-virtual 3.0.4
  Uname: Linux 3.0.0-12-virtual x86_64
  ApportVersion: 1.23-0ubuntu3
  Architecture: amd64
  Date: Thu Oct 27 22:27:29 2011
  Ec2AMI: ami-bbf539d2
  Ec2AMIManifest: (unknown)
  Ec2AvailabilityZone: us-east-1d
  Ec2InstanceType: m1.large
  Ec2Kernel: aki-825ea7eb
  Ec2Ramdisk: unavailable
  ProcEnviron:
   LC_CTYPE=en_US.UTF-8
   LC_COLLATE=en_US.UTF-8
   LANG=en_US.UTF-8
   LC_MESSAGES=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: apt
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/apt/+bug/882832/+subscriptions