[Bug 1879712] [NEW] gnocchi-api fails upstream STEIN installation

alfiaz alfiaz at teoco.com
Wed May 20 14:01:46 UTC 2020 

Public bug reported:

CentOS 7 on bare-metal
active production OpenStack Stein
Trying to install Ceilometer

checking the status of the gnocchi services, it shows the API has failed to start
trying to invoke the API ExecStart manually, shows why
please advise


[root at controller]# systemctl status openstack-gnocchi-api.service

gnocchi-api.service - Gnocchi API service
   Loaded: loaded (/usr/lib/systemd/system/gnocchi-api.service; enabled; vendor preset: disabled)
   Active: failed (Result: start-limit) since Wed 2020-05-20 16:05:35 IDT; 39min ago
  Process: 32176 ExecStart=/usr/bin/gnocchi-api --log-file /var/log/gnocchi/api.log --verbose (code=exited, status=1/FAILURE)
 Main PID: 32176 (code=exited, status=1/FAILURE)

May 20 16:05:34 controller systemd[1]: Unit gnocchi-api.service entered failed state.
May 20 16:05:34 controller systemd[1]: gnocchi-api.service failed.
May 20 16:05:35 controller systemd[1]: gnocchi-api.service holdoff time over, scheduling restart.
May 20 16:05:35 controller systemd[1]: Stopped Gnocchi API service.
May 20 16:05:35 controller systemd[1]: start request repeated too quickly for gnocchi-api.service
May 20 16:05:35 controller systemd[1]: Failed to start Gnocchi API service.
May 20 16:05:35 controller systemd[1]: Unit gnocchi-api.service entered failed state.
May 20 16:05:35 controller systemd[1]: gnocchi-api.service failed.


[root at controller]# /usr/bin/gnocchi-api
open("/usr/lib64/uwsgi/python_plugin.so"): No such file or directory [core/utils.c line 3713]
!!! UNABLE to load uWSGI plugin: /usr/lib64/uwsgi/python_plugin.so: cannot open shared object file: No such file or directory !!!
/sbin/uwsgi: unrecognized option '--wsgi'
getopt_long() error





set the api log to debug for more info. here's the output from /var/log/gnocchi/api.log


2020-05-20 16:05:34,889 [32176] DEBUG    gnocchi.service: database.db_max_retries        = 20
2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.db_max_retry_interval = 10
2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.db_retry_interval     = 1
2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.max_overflow          = 50
2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.max_pool_size         = 5
2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.max_retries           = 10
2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.min_pool_size         = 1
2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.mysql_enable_ndb      = False
2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.mysql_sql_mode        = TRADITIONAL
2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.pool_timeout          = None
2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.retry_interval        = 10
2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.slave_connection      = ****
2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.sqlite_synchronous    = True
2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.use_db_reconnect      = False
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_conffile          = /etc/ceph/ceph.conf
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_keyring           = None
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_pool              = gnocchi
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_secret            = ****
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_timeout           = 30
2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_username          = None
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.driver                 = file
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.file_basepath          = /var/lib/gnocchi
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.file_subdir_len        = 2
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.redis_url              = redis://localhost:6379/
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_access_key_id       = None
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_bucket_prefix       = gnocchi
2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_check_consistency_timeout = 60.0
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_endpoint_url        = None
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_max_pool_connections = 50
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_region_name         = None
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_secret_access_key   = None
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_auth_insecure    = False
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_auth_version     = 1
2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_authurl          = http://localhost:8080/auth/v1.0
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_cacert           = None
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_container_prefix = gnocchi
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_endpoint_type    = publicURL
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_key              = ****
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_preauthtoken     = ****
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_project_domain_name = Default
2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_project_name     = None
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_region           = None
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_service_type     = object-store
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_timeout          = 300
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_url              = None
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_user             = admin:admin
2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_user_domain_name = Default
2020-05-20 16:05:34,898 [32176] DEBUG    gnocchi.service: indexer.url                    = ****
2020-05-20 16:05:34,898 [32176] DEBUG    gnocchi.service: api.auth_mode                  = keystone
2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.host                       = controller
2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.max_limit                  = 1000
2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.operation_timeout          = 10
2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.paste_config               = api-paste.ini
2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: api.port                       = 8041
2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: api.uwsgi_mode                 = http-socket
2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: archive_policy.default_aggregation_methods = ['mean', 'min', 'max', 'sum', 'std', 'count']
2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: oslo_policy.enforce_scope      = False
2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_default_rule = default
2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_dirs        = ['policy.d']
2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_file        = policy.json
2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.remote_content_type = application/x-www-form-urlencoded
2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_ca_crt_file = None
2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_client_crt_file = None
2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_client_key_file = None
2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_verify_server_crt = False
2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: ********************************************************************************

** Affects: ceilometer (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ceilometer in Ubuntu.
https://bugs.launchpad.net/bugs/1879712

Title:
  gnocchi-api fails upstream STEIN installation

Status in ceilometer package in Ubuntu:
  New

Bug description:
  CentOS 7 on bare-metal
  active production OpenStack Stein
  Trying to install Ceilometer

  checking the status of the gnocchi services, it shows the API has failed to start
  trying to invoke the API ExecStart manually, shows why
  please advise


  
  [root at controller]# systemctl status openstack-gnocchi-api.service 

  gnocchi-api.service - Gnocchi API service
     Loaded: loaded (/usr/lib/systemd/system/gnocchi-api.service; enabled; vendor preset: disabled)
     Active: failed (Result: start-limit) since Wed 2020-05-20 16:05:35 IDT; 39min ago
    Process: 32176 ExecStart=/usr/bin/gnocchi-api --log-file /var/log/gnocchi/api.log --verbose (code=exited, status=1/FAILURE)
   Main PID: 32176 (code=exited, status=1/FAILURE)

  May 20 16:05:34 controller systemd[1]: Unit gnocchi-api.service entered failed state.
  May 20 16:05:34 controller systemd[1]: gnocchi-api.service failed.
  May 20 16:05:35 controller systemd[1]: gnocchi-api.service holdoff time over, scheduling restart.
  May 20 16:05:35 controller systemd[1]: Stopped Gnocchi API service.
  May 20 16:05:35 controller systemd[1]: start request repeated too quickly for gnocchi-api.service
  May 20 16:05:35 controller systemd[1]: Failed to start Gnocchi API service.
  May 20 16:05:35 controller systemd[1]: Unit gnocchi-api.service entered failed state.
  May 20 16:05:35 controller systemd[1]: gnocchi-api.service failed.

  
  [root at controller]# /usr/bin/gnocchi-api
  open("/usr/lib64/uwsgi/python_plugin.so"): No such file or directory [core/utils.c line 3713]
  !!! UNABLE to load uWSGI plugin: /usr/lib64/uwsgi/python_plugin.so: cannot open shared object file: No such file or directory !!!
  /sbin/uwsgi: unrecognized option '--wsgi'
  getopt_long() error







  
  set the api log to debug for more info. here's the output from /var/log/gnocchi/api.log

  
  2020-05-20 16:05:34,889 [32176] DEBUG    gnocchi.service: database.db_max_retries        = 20
  2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.db_max_retry_interval = 10
  2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.db_retry_interval     = 1
  2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.max_overflow          = 50
  2020-05-20 16:05:34,890 [32176] DEBUG    gnocchi.service: database.max_pool_size         = 5
  2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.max_retries           = 10
  2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.min_pool_size         = 1
  2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.mysql_enable_ndb      = False
  2020-05-20 16:05:34,891 [32176] DEBUG    gnocchi.service: database.mysql_sql_mode        = TRADITIONAL
  2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.pool_timeout          = None
  2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.retry_interval        = 10
  2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.slave_connection      = ****
  2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.sqlite_synchronous    = True
  2020-05-20 16:05:34,892 [32176] DEBUG    gnocchi.service: database.use_db_reconnect      = False
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_conffile          = /etc/ceph/ceph.conf
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_keyring           = None
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_pool              = gnocchi
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_secret            = ****
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_timeout           = 30
  2020-05-20 16:05:34,893 [32176] DEBUG    gnocchi.service: storage.ceph_username          = None
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.driver                 = file
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.file_basepath          = /var/lib/gnocchi
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.file_subdir_len        = 2
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.redis_url              = redis://localhost:6379/
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_access_key_id       = None
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_bucket_prefix       = gnocchi
  2020-05-20 16:05:34,894 [32176] DEBUG    gnocchi.service: storage.s3_check_consistency_timeout = 60.0
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_endpoint_url        = None
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_max_pool_connections = 50
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_region_name         = None
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.s3_secret_access_key   = None
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_auth_insecure    = False
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_auth_version     = 1
  2020-05-20 16:05:34,895 [32176] DEBUG    gnocchi.service: storage.swift_authurl          = http://localhost:8080/auth/v1.0
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_cacert           = None
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_container_prefix = gnocchi
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_endpoint_type    = publicURL
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_key              = ****
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_preauthtoken     = ****
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_project_domain_name = Default
  2020-05-20 16:05:34,896 [32176] DEBUG    gnocchi.service: storage.swift_project_name     = None
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_region           = None
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_service_type     = object-store
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_timeout          = 300
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_url              = None
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_user             = admin:admin
  2020-05-20 16:05:34,897 [32176] DEBUG    gnocchi.service: storage.swift_user_domain_name = Default
  2020-05-20 16:05:34,898 [32176] DEBUG    gnocchi.service: indexer.url                    = ****
  2020-05-20 16:05:34,898 [32176] DEBUG    gnocchi.service: api.auth_mode                  = keystone
  2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.host                       = controller
  2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.max_limit                  = 1000
  2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.operation_timeout          = 10
  2020-05-20 16:05:34,899 [32176] DEBUG    gnocchi.service: api.paste_config               = api-paste.ini
  2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: api.port                       = 8041
  2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: api.uwsgi_mode                 = http-socket
  2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: archive_policy.default_aggregation_methods = ['mean', 'min', 'max', 'sum', 'std', 'count']
  2020-05-20 16:05:34,900 [32176] DEBUG    gnocchi.service: oslo_policy.enforce_scope      = False
  2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_default_rule = default
  2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_dirs        = ['policy.d']
  2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.policy_file        = policy.json
  2020-05-20 16:05:34,901 [32176] DEBUG    gnocchi.service: oslo_policy.remote_content_type = application/x-www-form-urlencoded
  2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_ca_crt_file = None
  2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_client_crt_file = None
  2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_client_key_file = None
  2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: oslo_policy.remote_ssl_verify_server_crt = False
  2020-05-20 16:05:34,902 [32176] DEBUG    gnocchi.service: ********************************************************************************

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ceilometer/+bug/1879712/+subscriptions

More information about the Ubuntu-openstack-bugs mailing list