[Bug 1784757] Re: rabbitmq-server does not properly shutdown

[Benjamin DeCamp]

I can confirm this issue on the latest versions of 18.04.2, somewhat
nasty, really slows down reboots when RabbitMQ is installed. Here's
reproduce steps to see the bug in action:

rabbitmq installed via "sudo apt install rabbitmq-server"

Stop the service: "sudo systemctl stop rabbitmq-server.service"

Then running "status", we can see the 90 second delay between the stop
attempt at 10:31:06, and it giving up and killing the service at
10:32:36

$ sudo systemctl status rabbitmq-server.service
[sudo] password for nearlotech:
● rabbitmq-server.service - RabbitMQ Messaging Server
   Loaded: loaded (/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: enabled)
   Active: failed (Result: timeout) since Thu 2019-05-09 10:32:36 MDT; 1min 32s ago
  Process: 2409 ExecStop=/usr/sbin/rabbitmqctl stop (code=exited, status=0/SUCCESS)
  Process: 899 ExecStartPost=/usr/lib/rabbitmq/bin/rabbitmq-server-wait (code=exited, status=0/SUCCESS)
  Process: 898 ExecStart=/usr/sbin/rabbitmq-server (code=killed, signal=TERM)
 Main PID: 898 (code=killed, signal=TERM)

May 09 10:30:43 ubuntu1804vm systemd[1]: Starting RabbitMQ Messaging Server...
May 09 10:30:46 ubuntu1804vm rabbitmq[899]: Waiting for 'rabbit at ubuntu1804vm'
May 09 10:30:46 ubuntu1804vm rabbitmq[899]: pid is 978
May 09 10:30:50 ubuntu1804vm systemd[1]: Started RabbitMQ Messaging Server.
May 09 10:31:05 ubuntu1804vm systemd[1]: Stopping RabbitMQ Messaging Server...
May 09 10:31:06 ubuntu1804vm rabbitmq[2409]: Stopping and halting node 'rabbit at ubuntu1804vm'
May 09 10:32:36 ubuntu1804vm systemd[1]: rabbitmq-server.service: State 'stop-final-sigterm' timed out. Killing.
May 09 10:32:36 ubuntu1804vm systemd[1]: rabbitmq-server.service: Killing process 2706 (epmd) with signal SIGKILL.
May 09 10:32:36 ubuntu1804vm systemd[1]: rabbitmq-server.service: Failed with result 'timeout'.
May 09 10:32:36 ubuntu1804vm systemd[1]: Stopped RabbitMQ Messaging Server.

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to rabbitmq-server in Ubuntu.
https://bugs.launchpad.net/bugs/1784757

Title:
  rabbitmq-server does not properly shutdown

Status in rabbitmq-server package in Ubuntu:
  Confirmed

Bug description:
  When I run `systemctl restart rabbitmq-server` it waits for 90 seconds
  then systemd sends SIGKILL to it.

  Presumably the `epmd` process does not receive SIGTERM, since if I run
  `kill 1493` (or whatever pid it currently is) then restart happens
  straight after that successfully

  ● rabbitmq-server.service - RabbitMQ Messaging Server
     Loaded: loaded (/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: enabled)
     Active: deactivating (final-sigterm) since Wed 2018-08-01 01:17:04 UTC; 7s ago
    Process: 1183 ExecStop=/usr/sbin/rabbitmqctl stop (code=exited, status=0/SUCCESS)
    Process: 178 ExecStartPost=/usr/lib/rabbitmq/bin/rabbitmq-server-wait (code=exited, status=0/SUCCESS)
    Process: 177 ExecStart=/usr/sbin/rabbitmq-server (code=killed, signal=TERM)
   Main PID: 177 (code=killed, signal=TERM)
      Tasks: 1 (limit: 4915)
     CGroup: /system.slice/rabbitmq-server.service
             └─1493 /usr/lib/erlang/erts-9.2/bin/epmd -daemon

  Aug 01 01:11:20 rmq-1 systemd[1]: rabbitmq-server.service: Failed to reset devices.list: Operation not permitted
  Aug 01 01:11:20 rmq-1 systemd[1]: Starting RabbitMQ Messaging Server...
  Aug 01 01:11:25 rmq-1 rabbitmq[178]: Waiting for 'rabbit at rmq-1'
  Aug 01 01:11:25 rmq-1 rabbitmq[178]: pid is 204
  Aug 01 01:11:30 rmq-1 systemd[1]: Started RabbitMQ Messaging Server.
  Aug 01 01:17:04 rmq-1 systemd[1]: Stopping RabbitMQ Messaging Server...
  Aug 01 01:17:06 rmq-1 rabbitmq[1183]: Stopping and halting node 'rabbit at rmq-1'

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1784757/+subscriptions