[Bug 1504340] [NEW] Upgrade from 1.5 to 1.9 fails in network migration

Thu Oct 8 22:40:19 UTC 2015

Public bug reported:

Attempted to upgrade Trusty from 1.5 to 1.9.
Please see the output below.

jenkins at juju-qa-maas-server-1:~$ sudo apt-get upgrade maas
[sudo] password for jenkins: 
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  avahi-daemon avahi-utils erlang-asn1 erlang-base erlang-corba erlang-crypto
  erlang-diameter erlang-edoc erlang-eldap erlang-erl-docgen erlang-eunit
  erlang-ic erlang-inets erlang-mnesia erlang-nox erlang-odbc erlang-os-mon
  erlang-parsetools erlang-percept erlang-public-key erlang-runtime-tools
  erlang-snmp erlang-ssh erlang-ssl erlang-syntax-tools erlang-tools
  erlang-webtool erlang-xmerl libavahi-core7 libdaemon0 libjs-raphael
  libnss-mdns libodbc1 libsctp1 lksctp-tools pwgen python-amqp python-amqplib
  python-anyjson python-billiard python-celery python-cl python-dateutil
  python-iscpy python-kombu python-lockfile python-mailer python-memcache
  python-oops python-oops-amqp python-oops-datedir-repo python-oops-twisted
  python-oops-wsgi python-txamqp python-txlongpoll rabbitmq-server
Use 'apt-get autoremove' to remove them.
The following packages will be REMOVED:
  squid-deb-proxy
The following NEW packages will be installed:
  libjs-angularjs maas-proxy
The following packages have been kept back:
  linux-generic linux-headers-generic linux-image-generic
The following packages will be upgraded:
  maas maas-cli maas-cluster-controller maas-common maas-dhcp maas-dns
  maas-region-controller maas-region-controller-min python-django-maas
  python-maas-client python-maas-provisioningserver
11 upgraded, 2 newly installed, 1 to remove and 3 not upgraded.
Need to get 2,542 kB of archives.
After this operation, 12.6 MB of additional disk space will be used.
Do you want to continue? [Y/n] 
Get:1 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main python-maas-provisioningserver all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [211 kB]
Get:2 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-cluster-controller all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [33.0 kB]
Get:3 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-region-controller all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [23.0 kB]
Get:4 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-dns all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [21.4 kB]
Get:5 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-region-controller-min all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [1,330 kB]
Get:6 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main python-django-maas all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [500 kB]
Get:7 http://us.archive.ubuntu.com/ubuntu/ trusty/universe libjs-angularjs all 1.2.11-1 [272 kB]
Get:8 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-cli all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [34.2 kB]
Get:9 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main python-maas-client all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [26.8 kB]
Get:10 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-common all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [21.3 kB]
Get:11 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-dhcp all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [23.8 kB]
Get:12 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas-proxy all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [23.5 kB]
Get:13 http://ppa.launchpad.net/maas-maintainers/experimental/ubuntu/ trusty/main maas all 1.9.0~alpha3+bzr4363-0ubuntu1~trusty1 [21.2 kB]
Fetched 2,542 kB in 1s (2,255 kB/s)                               
Preconfiguring packages ...
(Reading database ... 76605 files and directories currently installed.)
Preparing to unpack .../python-maas-provisioningserver_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking python-maas-provisioningserver (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-cluster-controller_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
maas-cluster-celery stop/waiting
maas-pserv stop/waiting
Obsolete conffile /etc/maas/bootresources.yaml has been modified by you.
Saving as /etc/maas/bootresources.yaml.dpkg-bak ...
Obsolete conffile /etc/maas/maas_local_celeryconfig_cluster.py has been modified by you.
Saving as /etc/maas/maas_local_celeryconfig_cluster.py.dpkg-bak ...
Moving obsolete conffile /etc/init/maas-cluster-celery.conf out of the way...
Moving obsolete conffile /etc/init/maas-pserv.conf out of the way...
Moving obsolete conffile /etc/maas/maas-cluster-http.conf out of the way...
Moving obsolete conffile /etc/maas/templates/power/mscm.template out of the way...
Moving obsolete conffile /etc/maas/templates/power/sm15k.template out of the way...
Moving obsolete conffile /etc/maas/templates/power/ucsm.template out of the way...
Moving obsolete conffile /etc/maas/templates/power/virsh.template out of the way...
Moving obsolete conffile /etc/maas/templates/power/ipmi.conf out of the way...
Moving obsolete conffile /etc/maas/templates/power/ipmi.template out of the way...
Unpacking maas-cluster-controller (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-region-controller_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
 * Stopping web server apache2                                                   * 
Unpacking maas-region-controller (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-dns_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking maas-dns (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
 * Stopping domain name service... bind9                                        waiting for pid 953 to die
giving up on pid 953 with kill -0; trying -9
                                                                         [ OK ]
 * Starting domain name service... bind9                                 [ OK ] 
Preparing to unpack .../maas-region-controller-min_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
 * Stopping web server apache2                                                   * 
maas-txlongpoll stop/waiting
maas-region-celery stop/waiting
Obsolete conffile /etc/maas/txlongpoll.yaml has been modified by you.
Saving as /etc/maas/txlongpoll.yaml.dpkg-bak ...
Moving obsolete conffile /etc/init/maas-txlongpoll.conf out of the way...
Moving obsolete conffile /etc/init/maas-region-celery.conf out of the way...
Obsolete conffile /etc/maas/maas_local_celeryconfig.py has been modified by you.
Saving as /etc/maas/maas_local_celeryconfig.py.dpkg-bak ...
Moving obsolete conffile /etc/maas/maas-http.conf out of the way...
Unpacking maas-region-controller-min (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
dpkg: warning: unable to delete old directory '/var/log/maas/oops': Directory not empty
dpkg: warning: unable to delete old directory '/var/log/maas': Directory not empty
Preparing to unpack .../python-django-maas_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking python-django-maas (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-cli_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking maas-cli (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../python-maas-client_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking python-maas-client (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-common_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking maas-common (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Preparing to unpack .../maas-dhcp_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
maas-dhcp-server stop/waiting
Moving obsolete conffile /etc/init/maas-dhcp-server.conf out of the way...
Unpacking maas-dhcp (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Selecting previously unselected package libjs-angularjs.
Preparing to unpack .../libjs-angularjs_1.2.11-1_all.deb ...
Unpacking libjs-angularjs (1.2.11-1) ...
Processing triggers for ureadahead (0.100.0-16) ...
ureadahead will be reprofiled on next reboot
Processing triggers for man-db (2.6.7.1-1ubuntu1) ...
(Reading database ... 77568 files and directories currently installed.)
Removing squid-deb-proxy (0.8.6ubuntu1) ...
squid-deb-proxy stop/waiting
Selecting previously unselected package maas-proxy.
(Reading database ... 77563 files and directories currently installed.)
Preparing to unpack .../maas-proxy_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking maas-proxy (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Preparing to unpack .../maas_1.9.0~alpha3+bzr4363-0ubuntu1~trusty1_all.deb ...
Unpacking maas (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) over (1.5.4+bzr2294-0ubuntu1.1) ...
Processing triggers for ureadahead (0.100.0-16) ...
Setting up python-maas-client (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Setting up python-maas-provisioningserver (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Setting up maas-cli (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Setting up maas-common (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Setting up maas-dhcp (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Installing new version of config file /etc/apparmor.d/dhcpd.d/maas ...
maas-dhcpd start/running, process 3058
maas-dhcpd6 stop/pre-start, process 3106
Removing obsolete conffile /etc/init/maas-dhcp-server.conf ...
Setting up libjs-angularjs (1.2.11-1) ...
Setting up maas-proxy (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
squid3 stop/waiting
maas-proxy start/running, process 3198
Setting up python-django-maas (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas-cluster-controller (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Installing new version of config file /etc/logrotate.d/maas-cluster-controller ...
Installing new version of config file /etc/sudoers.d/99-maas-sudoers ...
Installing new version of config file /etc/maas/templates/dhcp/dhcpd.conf.template ...
Installing new version of config file /etc/maas/templates/power/dli.template ...
Installing new version of config file /etc/maas/templates/power/amt.template ...
Installing new version of config file /etc/maas/templates/pxe/config.commissioning.template ...
Installing new version of config file /etc/maas/templates/pxe/config.xinstall.template ...
maas-clusterd start/running, process 3388
Removing obsolete conffile /etc/init/maas-cluster-celery.conf ...
Removing obsolete conffile /etc/init/maas-pserv.conf ...
Removing obsolete conffile /etc/maas/maas-cluster-http.conf ...
Removing obsolete conffile /etc/maas/templates/power/mscm.template ...
Removing obsolete conffile /etc/maas/templates/power/sm15k.template ...
Removing obsolete conffile /etc/maas/templates/power/ucsm.template ...
Removing obsolete conffile /etc/maas/templates/power/virsh.template ...
Removing obsolete conffile /etc/maas/templates/power/ipmi.conf ...
Removing obsolete conffile /etc/maas/templates/power/ipmi.template ...
Setting up maas-region-controller-min (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
Installing new version of config file /etc/logrotate.d/maas-region-controller-min ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/user_data_config.template ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_moonshot_autodetect.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_get.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_api_helper.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_signal.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_ipmi_autodetect.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_ipmi_autodetect_tool.py ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/snippets/maas_enlist.sh ...
Installing new version of config file /etc/maas/templates/commissioning-user-data/user_data.template ...
Installing new version of config file /etc/maas/templates/dns/named.conf.options.inside.maas.template ...
Installing new version of config file /etc/maas/templates/dns/zone.template ...
Installing new version of config file /etc/maas/templates/dns/named.conf.template ...
Installing new version of config file /etc/maas/drivers.yaml ...
Installing new version of config file /etc/maas/preseeds/enlist_userdata ...
Installing new version of config file /etc/maas/preseeds/generic ...
rsyslog stop/waiting
rsyslog start/running, process 3525
 * Stopping web server apache2                                                   * 
Considering dependency proxy for proxy_http:
Module proxy already enabled
Module proxy_http already enabled
Considering dependency proxy for proxy_wstunnel:
Module proxy already enabled
Enabling module proxy_wstunnel.
To activate the new configuration, you need to run:
  service apache2 restart
Module expires already enabled
Enabling module rewrite.
To activate the new configuration, you need to run:
  service apache2 restart
 * Restarting web server apache2                                                AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 10.0.30.100. Set the 'ServerName' directive globally to suppress this message
                                                                         [ OK ]
maas-regiond start/running
Removing obsolete conffile /etc/init/maas-txlongpoll.conf ...
Removing obsolete conffile /etc/init/maas-region-celery.conf ...
Removing obsolete conffile /etc/maas/maas-http.conf ...
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas-dns (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
 * Stopping domain name service... bind9                                        waiting for pid 2384 to die
                                                                         [ OK ]
 * Starting domain name service... bind9                                 [ OK ] 
Setting up maas-region-controller (1.9.0~alpha3+bzr4363-0ubuntu1~trusty1) ...
 * Stopping web server apache2                                                   * 
 * Restarting PostgreSQL 9.3 database server                             [ OK ] 
Syncing...
Creating tables ...
Installing custom SQL ...
Installing indexes ...
Installed 0 object(s) from 0 fixture(s)

Synced:
 > django.contrib.auth
 > django.contrib.contenttypes
 > django.contrib.sessions
 > django.contrib.sites
 > django.contrib.messages
 > django.contrib.staticfiles
 > piston
 > south

Not synced (use migrations):
 - maasserver
 - metadataserver
(use ./manage.py migrate to migrate these)
Running migrations for maasserver:
 - Migrating forwards to 0182_initial_networking_layout.
 > metadataserver:0015_rename_nodecommissionresult_add_result_type
 > maasserver:0075_add_boot_resource_models
 > maasserver:0076_add_osystem_to_bootimage
 > maasserver:0077_remove_null_for_bootsourceselection_release
 > maasserver:0078_add_osystem_to_node
 > maasserver:0079_supported_subarches_for_bootimage
 > maasserver:0080_binary_to_editablebinary_in_bootsource
 > maasserver:0081_ipaddress_table_and_static_dhcp_ranges
 > maasserver:0082_cluster_interface_for_macaddress
 > maasserver:0083_add_license_key_to_node
 > maasserver:0084_add_ssl_key_model
 > maasserver:0085_add_user_to_staticipaddress
 > maasserver:0086_add_xinstall_path_and_type_to_bootimage
 > maasserver:0087_add_licensekey_model
 > maasserver:0088_ip_to_custom_field
 > maasserver:0088_z_backport_trunk_0099
 > maasserver:0089_create_nodegroupinterface_name
 > maasserver:0090_initialise_nodegroupinterface_name
 > maasserver:0091_add_boot_type_to_node
 > maasserver:0092_populate_node_boot_type
 > maasserver:0093_add_eventtype_and_event
 > maasserver:0094_add_error_description
 > maasserver:0095_add_event_description
 > maasserver:0096_add_power_state_to_node
 > maasserver:0097_add_largefile_model
 > maasserver:0098_add_bootresource_models
 > maasserver:0099_convert_cluster_interfaces_to_networks
 > maasserver:0100_remove_cluster_from_bootsrouce
 > maasserver:0100_remove_duplicate_bootsource_urls
 > maasserver:0101_make_bootsource_url_unique
 > maasserver:0102_candidate_name
 > maasserver:0103_candidate_names
 > maasserver:0104_add_node_disable_ipv4
 > maasserver:0105_remove_rtype_from_uniqueness_on_boot_resource
 > maasserver:0106_add_os_to_boot_source_selection
 > maasserver:0107_add_default_gateway_to_network
 > maasserver:0108_migrate_allocated_netboot
 > maasserver:0109_networks_dns_servers
 > maasserver:0110_deployed_state_compat
 > maasserver:0111_add_nodegroup_default_disable_ipv4
 > maasserver:0112_remove_boot_image_model
 > maasserver:0113_add_boot_source_cache_model
 > maasserver:0114_add_pxe_mac_to_node
 > maasserver:0115_unique_boot_source_selections
 > maasserver:0116_unique_boot_source_selections
 > maasserver:0117_delete_duplicate_config
 > maasserver:0118_config_key_unique
 > maasserver:0119_migrate_invalid_network_names
Error in migration: maasserver:0119_migrate_invalid_network_names
Traceback (most recent call last):
  File "/usr/sbin/maas-region-admin", line 68, in <module>
    main()
  File "/usr/sbin/maas-region-admin", line 64, in main
    run()
  File "/usr/sbin/maas-region-admin", line 57, in run
    management.execute_from_command_line()
  File "/usr/lib/python2.7/dist-packages/django/core/management/__init__.py", line 399, in execute_from_command_line
    utility.execute()
  File "/usr/lib/python2.7/dist-packages/django/core/management/__init__.py", line 392, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/lib/python2.7/dist-packages/django/core/management/base.py", line 242, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/usr/lib/python2.7/dist-packages/django/core/management/base.py", line 285, in execute
    output = self.handle(*args, **options)
  File "/usr/lib/python2.7/dist-packages/south/management/commands/migrate.py", line 107, in handle
    ignore_ghosts = ignore_ghosts,
  File "/usr/lib/python2.7/dist-packages/south/migration/__init__.py", line 219, in migrate_app
    success = migrator.migrate_many(target, workplan, database)
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 235, in migrate_many
    result = migrator.__class__.migrate_many(migrator, target, migrations, database)
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 310, in migrate_many
    result = self.migrate(migration, database)
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 133, in migrate
    result = self.run(migration)
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 107, in run
    return self.run_migration(migration)
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 81, in run_migration
    migration_function()
  File "/usr/lib/python2.7/dist-packages/south/migration/migrators.py", line 57, in <lambda>
    return (lambda: direction(orm))
  File "/usr/lib/python2.7/dist-packages/maasserver/migrations/0119_migrate_invalid_network_names.py", line 47, in forwards
    network.name, existing_network_names)
  File "/usr/lib/python2.7/dist-packages/maasserver/migrations/0119_migrate_invalid_network_names.py", line 18, in ensure_unique_network_name
    invalid_chars_re = re.compile("[^\w-]+")
NameError: global name 're' is not defined

** Affects: maas (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to maas in Ubuntu.
https://bugs.launchpad.net/bugs/1504340

Title:
  Upgrade from 1.5 to 1.9 fails in network migration

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/maas/+bug/1504340/+subscriptions