[Bug 1535741] [NEW] UnicodeDecodeError when command report gibberish

[Martin Pitt]

Public bug reported:

We get a lot of errors like in
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
/autopkgtest-xenial/xenial/s390x/h/hg-git/20160119_123943@/log.gz after
all tests finished and the testbed gets cleaned up:

adt-run [12:39:41]: @@@@@@@@@@@@@@@@@@@@ summary
testsuite            PASS
mercurial-git        PASS
Unexpected error:
Traceback (most recent call last):
  File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 702, in mainloop
    command()
  File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 640, in command
    r = f(c, ce)
  File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 116, in cmd_close
    cleanup()
  File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 665, in cleanup
    caller.hook_cleanup()
  File "/home/ubuntu/autopkgtest/virt-subproc/adt-virt-lxc", line 275, in hook_cleanup
    stderr=subprocess.PIPE)
  File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 148, in execute_timeout
    (out, err) = sp.communicate(instr)
  File "/usr/lib/python3.5/subprocess.py", line 1055, in communicate
    stderr = self.stderr.read()
  File "/usr/lib/python3.5/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x85 in position 467: invalid start byte

So it seems lxc-stop is sending some gibberish or interrupted stream.
Don't fail like that and instead just show the original error message.

** Affects: autopkgtest (Ubuntu)
     Importance: High
     Assignee: Martin Pitt (pitti)
         Status: In Progress

** Changed in: autopkgtest (Ubuntu)
       Status: New => In Progress

** Changed in: autopkgtest (Ubuntu)
   Importance: Undecided => High

** Changed in: autopkgtest (Ubuntu)
     Assignee: (unassigned) => Martin Pitt (pitti)

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to autopkgtest in Ubuntu.
https://bugs.launchpad.net/bugs/1535741

Title:
  UnicodeDecodeError when command report gibberish

Status in autopkgtest package in Ubuntu:
  In Progress

Bug description:
  We get a lot of errors like in
  https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac
  /autopkgtest-xenial/xenial/s390x/h/hg-git/20160119_123943@/log.gz
  after all tests finished and the testbed gets cleaned up:

  adt-run [12:39:41]: @@@@@@@@@@@@@@@@@@@@ summary
  testsuite            PASS
  mercurial-git        PASS
  Unexpected error:
  Traceback (most recent call last):
    File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 702, in mainloop
      command()
    File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 640, in command
      r = f(c, ce)
    File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 116, in cmd_close
      cleanup()
    File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 665, in cleanup
      caller.hook_cleanup()
    File "/home/ubuntu/autopkgtest/virt-subproc/adt-virt-lxc", line 275, in hook_cleanup
      stderr=subprocess.PIPE)
    File "/home/ubuntu/autopkgtest/lib/VirtSubproc.py", line 148, in execute_timeout
      (out, err) = sp.communicate(instr)
    File "/usr/lib/python3.5/subprocess.py", line 1055, in communicate
      stderr = self.stderr.read()
    File "/usr/lib/python3.5/codecs.py", line 321, in decode
      (result, consumed) = self._buffer_decode(data, self.errors, final)
  UnicodeDecodeError: 'utf-8' codec can't decode byte 0x85 in position 467: invalid start byte

  So it seems lxc-stop is sending some gibberish or interrupted stream.
  Don't fail like that and instead just show the original error message.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/autopkgtest/+bug/1535741/+subscriptions