[Blueprint servercloud-p-move-ec2-mirrors-to-s3] Move EC2 mirrors to S3

[Ben Howard]

Blueprint changed by Ben Howard:

Whiteboard changed:
  Rationale:
  S3 is a faster, more scalable technology that allows us to reduce costs and increase availability for EC2 users.
  
  Assumption:
    * Running on-EC2 mirrors is expensive and presents availability challenges.
    * on-EC2 mirrors have limited bandwidth and thus speeds can be affected by load
    * S3 has very high availability
    * S3 intra-region bandwidth is free
    * on-EC2 mirrors results in bandwidth charges when users use a mirror outside the availability zone
    * S3 is extremely fast. Generally speeds to S3 access are near-native
    * Amazon has asked for us to host our mirrors on S3
    * Uploads to S3 are free
  
  ___
  
  Example of access via S3.
  deb http://BUCKET/ubuntu/ oneiric main universe multiverse restricted
  deb http://BUCKET/ubuntu/ oneiric-updates main universe multiverse restricted
  deb http://BUCKET/security oneiric-security main  universe multiverse restricted
  
  deb-src http://BUCKET/ubuntu/ oneiric main universe multiverse restricted
  deb-src http://BUCKET/ubuntu/ oneiric-updates main universe multiverse restricted
  deb-src http://BUCKET/security oneiric-security main universe multiverse restricted
  
  ___
  
  Decision: Build S3 Regional mirror
  
  Work Items
  
- [utlemming]: Add APT Meta-parsing to script: TODO
- [utlemming]: Make script atomic: TODO
+ [utlemming]: Add APT Meta-parsing to script: DONE
+ [utlemming]: Make script atomic: DONE
  [utlemming]: Document process: TODO
  [canonical-sysadmins]: Add EC2 CNAMES: TODO
- [canonical-sysadmins]: Deploy solution: TODO
- 
+ [canonical-sysadmins]: Deploy solution: IN PROGRESS
  
      - a method of pushing pristine repositories up

-- 
Move EC2 mirrors to S3
https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-move-ec2-mirrors-to-s3