From Fedora Project Wiki

(launth instance error)
 
(Essex to Folsom upgrade notes)
Line 1: Line 1:
All is ok before 2012.5.15,which had not run yum update in centos6.2.
'''Essex to Folsom upgrade notes'''
I remmbered that as it would be exist the device demonetbr0 that have ip 10.0.0.1($> sudo nova-manage network create demonet 10.0.0.0/24 1 256 --bridge=demonetbr0),but haven't exist any more,and I created the device demonetbr0 using brctl command,but does not work.BUG??


I am having trouble with launching instances. The launch fails on
''Setting upgrade expectations right: off-line upgrade with manual intervention!''
networking task with status error. Here is the output (/var/log/nova/compute.log)on launching instance :


2012-05-20 03:38:55 INFO nova.rpc.impl_qpid [-] Connected to AMQP server on localhost:5672
Here are upgrade notes for upgrading simplest possible 2012.1.3 setup (all-in-one min.Nova+Glance+Keystone) to Folsom http://repos.fedorapeople.org/repos/openstack/openstack-folsom/epel-openstack-folsom.repo
2012-05-20 03:38:55 INFO nova.virt.libvirt.connection [-] Compute_service record updated for localhost
 
2012-05-20 03:38:57 ERROR nova.rpc.impl_qpid [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] Timed out waiting for RPC response: None
* stop services
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid Traceback (most recent call last):
service openstack-keystone stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 359, in ensure
service openstack-glance-api stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid    return method(*args, **kwargs)
service openstack-glance-registry stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 408, in _consume
service openstack-nova-compute stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid    nxt_receiver = self.session.next_receiver(timeout=timeout)
service openstack-nova-network stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid  File "<string>", line 6, in next_receiver
service openstack-nova-scheduler stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid  File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 651, in next_receiver
service openstack-nova-api stop
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid    raise Empty
* update RPMs
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid Empty: None
yum update openstack\* python\*client
2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid
* merge configs, they're customized when deployed, so you'll get .rpmnew
2012-05-20 03:38:57 ERROR nova.compute.manager [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Instance failed network setup
* /etc/keystone/
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Traceback (most recent call last):
** copy admin_token, [sql] connection from keystone.conf.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 565, in _allocate_network
  keystone.conf.rpmnew
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    requested_networks=requested_networks)
mv keystone.conf keystone.conf.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 170, in allocate_for_instance
mv keystone.conf.rpmnew keystone.conf
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    'args': args})
* /etc/glance/
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/__init__.py", line 68, in call
** copy admin_* from glance*paste.ini [filter:authtoken] to glance*.conf [keystone_authtoken]
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]     return _get_impl().call(context, topic, msg, timeout)
** verify sql_connection in both glance-registry.conf and glance-api.conf
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 521, in call
  glance-api.conf.rpmnew      glance-registry.conf.rpmnew
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    return rpc_amqp.call(context, topic, msg, timeout, Connection.pool)
  glance-api-paste.ini.rpmnew  glance-registry-paste.ini.rpmnew
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 343, in call
mv glance-registry.conf glance-registry.conf.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]     rv = list(rv)
mv glance-registry-paste.ini glance-registry-paste.ini.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]   File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 304, in __iter__
mv glance-registry.conf.rpmnew glance-registry.conf
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    self.done()
mv glance-registry-paste.ini.rpmnew glance-registry-paste.ini
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
* /etc/nova/
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    self.gen.next()
** copy admin_* from api-paste.ini [filter:authtoken] to nova.conf [keystone_authtoken]
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 301, in __iter__
** verify sql_connection in nova.conf
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    self._iterator.next()
  api-paste.ini.rpmnew  nova.conf.rpmnew
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 417, in iterconsume
mv api-paste.ini api-paste.ini.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    yield self.ensure(_error_callback, _consume)
mv api-paste.ini.rpmnew api-paste.ini
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 363, in ensure
mv nova.conf nova.conf.old
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]     error_callback(e)
mv nova.conf.rpmnew nova.conf
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]   File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 402, in _error_callback
*  verify other configs you might have customized
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]    raise rpc_common.Timeout()
e.g. /etc/openstack-dashboard/local_settings
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Timeout: Timeout while waiting on RPC response.
* update databases
2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69]
keystone-manage db_sync
2012-05-20 03:38:57 ERROR nova.rpc.amqp [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] Exception during message handling
glance-manage db_sync
2012-05-20 03:38:57 TRACE nova.rpc.amqp Traceback (most recent call last):
nova-manage db sync
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 253, in _process_data
* start services
2012-05-20 03:38:57 TRACE nova.rpc.amqp    rval = node_func(context=ctxt, **node_args)
service openstack-keystone start
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/exception.py", line 114, in wrapped
* test: keystone user-list
2012-05-20 03:38:57 TRACE nova.rpc.amqp    return f(*args, **kw)
service openstack-glance-api start
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 183, in decorated_function
service openstack-glance-registry start
2012-05-20 03:38:57 TRACE nova.rpc.amqp    sys.exc_info())
* test: glance index
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
service openstack-nova-api start
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self.gen.next()
service openstack-nova-scheduler start
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 177, in decorated_function
service openstack-nova-compute start
2012-05-20 03:38:57 TRACE nova.rpc.amqp    return function(self, context, instance_uuid, *args, **kwargs)
service openstack-nova-network start
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 657, in run_instance
* test: nova list
2012-05-20 03:38:57 TRACE nova.rpc.amqp    do_run_instance()
service httpd restart
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/utils.py", line 946, in inner
* test: http://localhost/dashboard
2012-05-20 03:38:57 TRACE nova.rpc.amqp    retval = f(*args, **kwargs)
* configure new components: cinder, quantum
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 656, in do_run_instance
* nova-network to quantum migration script, should be on upstream TODO list: https://lists.launchpad.net/openstack/msg16469.html
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self._run_instance(context, instance_uuid, **kwargs)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 457, in _run_instance
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self._set_instance_error_state(context, instance_uuid)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self.gen.next()
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 430, in _run_instance
2012-05-20 03:38:57 TRACE nova.rpc.amqp    requested_networks)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 565, in _allocate_network
2012-05-20 03:38:57 TRACE nova.rpc.amqp    requested_networks=requested_networks)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 170, in allocate_for_instance
2012-05-20 03:38:57 TRACE nova.rpc.amqp    'args': args})
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/__init__.py", line 68, in call
2012-05-20 03:38:57 TRACE nova.rpc.amqp    return _get_impl().call(context, topic, msg, timeout)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 521, in call
2012-05-20 03:38:57 TRACE nova.rpc.amqp    return rpc_amqp.call(context, topic, msg, timeout, Connection.pool)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 343, in call
2012-05-20 03:38:57 TRACE nova.rpc.amqp    rv = list(rv)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 304, in __iter__
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self.done()
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self.gen.next()
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 301, in __iter__
2012-05-20 03:38:57 TRACE nova.rpc.amqp    self._iterator.next()
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 417, in iterconsume
2012-05-20 03:38:57 TRACE nova.rpc.amqp    yield self.ensure(_error_callback, _consume)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 363, in ensure
2012-05-20 03:38:57 TRACE nova.rpc.amqp    error_callback(e)
2012-05-20 03:38:57 TRACE nova.rpc.amqp  File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 402, in _error_callback
2012-05-20 03:38:57 TRACE nova.rpc.amqp    raise rpc_common.Timeout()
2012-05-20 03:38:57 TRACE nova.rpc.amqp Timeout: Timeout while waiting on RPC response.
2012-05-20 03:38:57 TRACE nova.rpc.amqp

Revision as of 13:13, 31 October 2012

Essex to Folsom upgrade notes

Setting upgrade expectations right: off-line upgrade with manual intervention!

Here are upgrade notes for upgrading simplest possible 2012.1.3 setup (all-in-one min.Nova+Glance+Keystone) to Folsom http://repos.fedorapeople.org/repos/openstack/openstack-folsom/epel-openstack-folsom.repo

  • stop services
service openstack-keystone stop
service openstack-glance-api stop
service openstack-glance-registry stop
service openstack-nova-compute stop
service openstack-nova-network stop
service openstack-nova-scheduler stop
service openstack-nova-api stop
  • update RPMs
yum update openstack\* python\*client
  • merge configs, they're customized when deployed, so you'll get .rpmnew
  • /etc/keystone/
    • copy admin_token, [sql] connection from keystone.conf.old
  keystone.conf.rpmnew
mv keystone.conf keystone.conf.old
mv keystone.conf.rpmnew keystone.conf
  • /etc/glance/
    • copy admin_* from glance*paste.ini [filter:authtoken] to glance*.conf [keystone_authtoken]
    • verify sql_connection in both glance-registry.conf and glance-api.conf
  glance-api.conf.rpmnew       glance-registry.conf.rpmnew
  glance-api-paste.ini.rpmnew  glance-registry-paste.ini.rpmnew
mv glance-registry.conf glance-registry.conf.old
mv glance-registry-paste.ini glance-registry-paste.ini.old
mv glance-registry.conf.rpmnew glance-registry.conf
mv glance-registry-paste.ini.rpmnew glance-registry-paste.ini
  • /etc/nova/
    • copy admin_* from api-paste.ini [filter:authtoken] to nova.conf [keystone_authtoken]
    • verify sql_connection in nova.conf
  api-paste.ini.rpmnew  nova.conf.rpmnew
mv api-paste.ini api-paste.ini.old
mv api-paste.ini.rpmnew api-paste.ini
mv nova.conf nova.conf.old
mv nova.conf.rpmnew nova.conf
  • verify other configs you might have customized
e.g. /etc/openstack-dashboard/local_settings
  • update databases
keystone-manage db_sync
glance-manage db_sync
nova-manage db sync
  • start services
service openstack-keystone start
  • test: keystone user-list
service openstack-glance-api start
service openstack-glance-registry start
  • test: glance index
service openstack-nova-api start
service openstack-nova-scheduler start
service openstack-nova-compute start
service openstack-nova-network start
  • test: nova list
service httpd restart
Retrieved from "https://fedoraproject.org/w/index.php?title=Talk:Getting_started_with_OpenStack_EPEL&oldid=309311"