[Bug 1561927] [NEW] Juju 1.25.3 - infinite loop on cluster-relation-changed - cinder/apache services constantly restarted

[Alvaro Uría]

Public bug reported:

LSB: Ubuntu 14.04.4 LTS
openstack: cloud:trusty-liberty
cinder packages: 2:7.0.1-0ubuntu1~cloud0
cinder charm: lp:charms/trusty/cinder;revno=106
Juju: 1.25.3.1
num_units: 3
related to hacluster charm (which remains idle)

Symptoms:
All three units constantly run cluster-relation-changed, causing restart of all cinder upstart jobs as well as apache2.
If a unit is stopped, the other two stop looping. By restarting stopped unit and juju resolving it, loop starts on all three.

Temp solution to end loop (only applied on cinder/1):
"""
@hooks.hook('cluster-relation-changed',
            'cluster-relation-departed')
@restart_on_change(restart_map(), stopstart=True)
def cluster_changed():
    #check_db_initialised()
    #CONFIGS.write_all()
    pass
"""

Such temporary solution was done at 13:08 (see attached 20160325-unit-
cinder-1.log). Once all three units settled, I rolledback
cluster_changed() config to original code (uncommenting
check_db_initialised and CONFIGS.write_all), at 13:09.

Please let me know if you need further details.

** Affects: cinder (Juju Charms Collection)
     Importance: Undecided
         Status: New


** Tags: canonical-bootstack

** Attachment added: "20160325-unit-cinder-1.log"
   https://bugs.launchpad.net/bugs/1561927/+attachment/4610974/+files/20160325-unit-cinder-1.log.gz

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to cinder in Juju Charms Collection.
Matching subscriptions: charm-bugs
https://bugs.launchpad.net/bugs/1561927

Title:
  Juju 1.25.3 - infinite loop on cluster-relation-changed -
  cinder/apache services constantly restarted

Status in cinder package in Juju Charms Collection:
  New

Bug description:
  LSB: Ubuntu 14.04.4 LTS
  openstack: cloud:trusty-liberty
  cinder packages: 2:7.0.1-0ubuntu1~cloud0
  cinder charm: lp:charms/trusty/cinder;revno=106
  Juju: 1.25.3.1
  num_units: 3
  related to hacluster charm (which remains idle)

  Symptoms:
  All three units constantly run cluster-relation-changed, causing restart of all cinder upstart jobs as well as apache2.
  If a unit is stopped, the other two stop looping. By restarting stopped unit and juju resolving it, loop starts on all three.

  Temp solution to end loop (only applied on cinder/1):
  """
  @hooks.hook('cluster-relation-changed',
              'cluster-relation-departed')
  @restart_on_change(restart_map(), stopstart=True)
  def cluster_changed():
      #check_db_initialised()
      #CONFIGS.write_all()
      pass
  """

  Such temporary solution was done at 13:08 (see attached 20160325-unit-
  cinder-1.log). Once all three units settled, I rolledback
  cluster_changed() config to original code (uncommenting
  check_db_initialised and CONFIGS.write_all), at 13:09.

  Please let me know if you need further details.

To manage notifications about this bug go to:
https://bugs.launchpad.net/charms/+source/cinder/+bug/1561927/+subscriptions