[Bug 2059721] Re: ovn db upgrade

[Dmitriy Rabotyagov]

Hi,

So, I totally see issues in ordering of tasks for OVN upgrade and couple of missing handlers we obviously need to cover.
However, I was able to launch OVN cluster after upgrade.

Basically, these steps should be taken for successful upgrade:

1. Upgrade/restart all ovn-controllers
2. Upgrade ovn-northd. Once it's upgraded you need to restart ovn-northd service and ovn-central right after it. Once 2 out of 3 ovn-northd are upgraded, DB upgrade will be performed to the new schema.

So eventually, I've updated 1st ovn-northd container to 22.04 and I got same output as you did:
root at aio1-neutron-ovn-northd-container-519166b6:/# ovn-nbctl --version
ovn-nbctl 23.03.1
Open vSwitch Library 3.1.2
DB Schema 7.0.0
root at aio1-neutron-ovn-northd-container-519166b6:/# ovsdb-client get-schema-version unix:/var/run/ovn/ovnnb_db.sock
6.1.0
root at aio1-neutron-ovn-northd-container-519166b6:/#

Then, I've updated second container to 22.04 and restarted ovn-northd and ovn-central, and got new schema on the first one right away:
root at aio1-neutron-ovn-northd-container-519166b6:/# ovsdb-client get-schema-version unix:/var/run/ovn/ovnnb_db.sock
7.0.0
root at aio1-neutron-ovn-northd-container-519166b6:/#


I will work on role/playbooks to cover upgrade process ordering and found nits.

** Changed in: openstack-ansible
       Status: New => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ovn in Ubuntu.
https://bugs.launchpad.net/bugs/2059721

Title:
  ovn db upgrade

Status in OpenStack-Ansible:
  Triaged
Status in ovn package in Ubuntu:
  New

Bug description:
  After distro upgrade of the openstack-ansible 2023.1 site from Ubuntu
  20.04 to Ubuntu 22.04 OVN cluster DB was not upgraded.

  root at b-mgmt-neutron-ovn-northd-container-cb715707:/var/log/ovn# ovn-nbctl --version
  ovn-nbctl 23.03.1
  Open vSwitch Library 3.1.2
  DB Schema 7.0.0

  root at b-mgmt-neutron-ovn-northd-container-cb715707:/var/log/ovn# ovn-sbctl --version
  ovn-sbctl 23.03.1
  Open vSwitch Library 3.1.2
  DB Schema 20.27.0

  However

  root at b-mgmt-neutron-ovn-northd-container-cb715707:/var/log/ovn# ovsdb-client get-schema-version unix:/var/run/ovn/ovnnb_db.sock OVN_Northbound
  6.1.0
  root at b-mgmt-neutron-ovn-northd-container-cb715707:/var/log/ovn# ovsdb-client get-schema-version unix:/var/run/ovn/ovnsb_db.sock OVN_Southbound
  20.21.0

  Restrarting ovn-central did not help.

  ovn-northd.log:
  2024-03-28T17:28:52.521Z|00053|ovsdb_idl|WARN|OVN_Southbound database lacks Chassis_Template_Var table (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00054|ovsdb_idl|WARN|Load_Balancer table in OVN_Southbound database lacks datapath_group column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00055|ovsdb_idl|WARN|MAC_Binding table in OVN_Southbound database lacks timestamp column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00056|ovsdb_idl|WARN|OVN_Southbound database lacks Mirror table (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00057|ovsdb_idl|WARN|Port_Binding table in OVN_Southbound database lacks additional_chassis column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00058|ovsdb_idl|WARN|Port_Binding table in OVN_Southbound database lacks additional_encap column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00059|ovsdb_idl|WARN|Port_Binding table in OVN_Southbound database lacks mirror_rules column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00060|ovsdb_idl|WARN|Port_Binding table in OVN_Southbound database lacks port_security column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00061|ovsdb_idl|WARN|Port_Binding table in OVN_Southbound database lacks requested_additional_chassis column (database needs upgrade?)
  2024-03-28T17:28:52.521Z|00062|ovsdb_idl|WARN|OVN_Southbound database lacks Static_MAC_Binding table (database needs upgrade?)

To manage notifications about this bug go to:
https://bugs.launchpad.net/openstack-ansible/+bug/2059721/+subscriptions