[Bug 983559] Re: package-data-downloader utility does not honor apt http proxy settings

[Adrianna Pińska]

No luck. Both commands hang at the download.  However, I have discovered
that the problem is not with finding the proxy settings (which are found
correctly -- it may not even be necessary to explicitly set the proxies
from the environment; this seems to be urllib's default behaviour).  The
script does download the file to a location in /tmp/ -- but it doesn't
do anything once the download is complete.

I made a minimal test case in python which reproduces this behaviour.
My script completes the download and exits normally if I change the url
to the Google homepage, but fails to exit if the url is the location of
the flash tarball.  I don't know whether this is related to the file
size or the server -- if I try to download a much smaller file from the
same directory in the Canonical archive it doesn't work.  If I upload
the tarball to another rempte server and try to download it from there,
it still doesn't work.

I can use my test case to download the tarball from my local server, but
only if I also unset all my proxy environment variables (and don't set
them in urllib).  (I don't know why that is necessary; I use the local
network's domain name for my local server, and I can download the file
with wget with all the environment variables set).

I suppose that I could use this as an elaborate workaround to install
both the necessary packages, but I would really like to understand the
underlying cause of the problem.

My proxy is cntlm.  It shouldn't require authentication (it takes care
of the authentication required by the upstream NTLM proxy).

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to update-notifier in Ubuntu.
https://bugs.launchpad.net/bugs/983559

Title:
  package-data-downloader utility does not honor apt http proxy settings

Status in “update-notifier” package in Ubuntu:
  Won't Fix

Bug description:
  I'm running 12.04 in an intranet where a proxy is required to get out.
  I set up apt-get with a proxy:

  $ cat /etc/apt/apt.conf.d/99proxy 
  Acquire::http::proxy "http://proxy:8080/";

  But running this fails:

  $ apt-get install flashplugin-installer
  Reading package lists... Done
  Building dependency tree       
  Reading state information... Done
  Suggested packages:
    ttf-mscorefonts-installer ttf-bitstream-vera ttf-dejavu ttf-xfree86-nonfree
    xfs
  The following NEW packages will be installed:
    flashplugin-installer
  0 upgraded, 1 newly installed, 0 to remove and 1 not upgraded.
  Need to get 8,292 B of archives.
  After this operation, 146 kB of additional disk space will be used.
  Get:1 http://archive.ubuntu.com/ubuntu/ precise/multiverse flashplugin-installer amd64 11.2.202.233ubuntu1 [8,292 B]
  Fetched 8,292 B in 0s (15.2 kB/s)                
  Preconfiguring packages ...
  Selecting previously unselected package flashplugin-installer.
  (Reading database ... 255509 files and directories currently installed.)
  Unpacking flashplugin-installer (from .../flashplugin-installer_11.2.202.233ubuntu1_amd64.deb) ...
  Processing triggers for update-notifier-common ...
  flashplugin-installer: downloading http://archive.canonical.com/pool/partner/a/adobe-flashplugin/adobe-flashplugin_11.2.202.228.orig.tar.gz
  Traceback (most recent call last):
    File "/usr/lib/update-notifier/package-data-downloader", line 234, in process_download_requests
      dest_file = urllib.urlretrieve(files[i])[0]
    File "/usr/lib/python2.7/urllib.py", line 93, in urlretrieve
      return _urlopener.retrieve(url, filename, reporthook, data)
    File "/usr/lib/python2.7/urllib.py", line 239, in retrieve
      fp = self.open(url, data)
    File "/usr/lib/python2.7/urllib.py", line 207, in open
      return getattr(self, name)(url)
    File "/usr/lib/python2.7/urllib.py", line 344, in open_http
      h.endheaders(data)
    File "/usr/lib/python2.7/httplib.py", line 954, in endheaders
      self._send_output(message_body)
    File "/usr/lib/python2.7/httplib.py", line 814, in _send_output
      self.send(msg)
    File "/usr/lib/python2.7/httplib.py", line 776, in send
      self.connect()
    File "/usr/lib/python2.7/httplib.py", line 757, in connect
      self.timeout, self.source_address)
    File "/usr/lib/python2.7/socket.py", line 571, in create_connection
      raise err
  IOError: [Errno socket error] [Errno 110] Connection timed out
  Setting up flashplugin-installer (11.2.202.233ubuntu1) ...

  
  I never put http_proxy in my environment.  So apt-get was able to download the .deb but not get the additional binary.  Since this process runs inside the context of apt-get, it seems it should pick up the proxy setting.

  ProblemType: Bug
  DistroRelease: Ubuntu 12.04
  Package: flashplugin-installer 11.2.202.233ubuntu1
  ProcVersionSignature: Ubuntu 3.2.0-23.36-generic 3.2.14
  Uname: Linux 3.2.0-23-generic x86_64
  ApportVersion: 2.0.1-0ubuntu4
  Architecture: amd64
  Date: Mon Apr 16 17:33:46 2012
  InstallationMedia: Kubuntu 12.04 LTS "Precise Pangolin" - Alpha amd64 (20111103)
  ProcEnviron:
   TERM=xterm
   SHELL=/bin/bash
   LANG=en_US.UTF-8
  SourcePackage: flashplugin-nonfree
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/update-notifier/+bug/983559/+subscriptions