[openstack-community] Error during multi-region setup.
Hello, I am trying to implement multi-region setup with OpenStack. I have two nodes with following configuration:- First node (node1):- Installed components:- MySQL, keystone, nova, glance, cinder, horizon, heat, ceilometer. Created two endpoints for each services with regionOne as this node and regionTwo as next node. Second node (node2):- Installed components:- MySQL, nova, glance, cinder, horizon, heat, ceilometer. All services are using node1 as auth (keystone) server and with local database. With above setup i can see two Regions at Horizon (Dashboard) of node1 and can create networks, routers, images at regionTwo. But while creating Instances i get following error at both nodes. *2013-12-26 11:58:07.130 2389 INFO nova.compute.manager [-] Running instance usage audit for host "HOSTNAME" from 2013-12-26 09:00:00 to 2013-12-26 10:00:00. 4 instances.* *2013-12-26 11:58:07.138 2389 ERROR nova.openstack.common.periodic_task [-] Error during ComputeManager._instance_usage_audit: Remote error: DBError SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]* *[u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 471, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1891, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper\n return f(*args, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 5435, in task_log_begin_task\n task.save()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/models.py", line 53, in save\n session.flush()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py", line 543, in _wrap\n raise exception.DBError(e)\n', u"DBError: SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]\n"].* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task Traceback (most recent call last):* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py", line 180, in run_periodic_tasks* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task(self, context)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4495, in _instance_usage_audit* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task self.host, num_instances)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 372, in start_instance_usage_audit* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task "Instance usage audit started...")* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 279, in task_log_begin_task* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task_items, message)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 411, in task_log_begin_task* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task_items=task_items, message=message)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 85, in call* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return self._invoke(self.proxy.call, ctxt, method, **kwargs)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 63, in _invoke* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return cast_or_call(ctxt, msg, **self.kwargs)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/proxy.py", line 126, in call* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task result = rpc.call(context, real_topic, msg, timeout)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/__init__.py", line 139, in call* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return _get_impl().call(CONF, context, topic, msg, timeout)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_kombu.py", line 816, in call* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task rpc_amqp.get_connection_pool(conf, Connection))* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 574, in call* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task rv = list(rv)* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 539, in __iter__* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task raise result* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task RemoteError: Remote error: DBError SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 471, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1891, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper\n return f(*args, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 5435, in task_log_begin_task\n task.save()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/models.py", line 53, in save\n session.flush()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py", line 543, in _wrap\n raise exception.DBError(e)\n', u"DBError: SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]\n"].* *2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task* *2013-12-26 11:58:07.141 2389 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources* *2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 35496* *2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 1689* *2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 2* *2013-12-26 11:58:07.670 2389 INFO nova.compute.resource_tracker [-] Compute_service record updated for "HOSTNAME":"HOSTNAME"*
Hello, Thanks for your support of OpenStack, and sorry you're experiencing problems. However, this mailing list is for people running OpenStack user groups to communicate and is not a support forum. Please ask your query on any of the following: 1) http://ask.openstack.org/ 2) The general mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack 3) The operators mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators Regards, Stefano On Thu 26 Dec 2013 03:10:21 AM PST, Sudarshan Pathak wrote:
Hello,
I am trying to implement multi-region setup with OpenStack. I have two nodes with following configuration:-
First node (node1):- Installed components:- MySQL, keystone, nova, glance, cinder, horizon, heat, ceilometer.
Created two endpoints for each services with regionOne as this node and regionTwo as next node.
Second node (node2):- Installed components:- MySQL, nova, glance, cinder, horizon, heat, ceilometer.
All services are using node1 as auth (keystone) server and with local database.
With above setup i can see two Regions at Horizon (Dashboard) of node1 and can create networks, routers, images at regionTwo.
But while creating Instances i get following error at both nodes.
/2013-12-26 11:58:07.130 2389 INFO nova.compute.manager [-] Running instance usage audit for host "HOSTNAME" from 2013-12-26 09:00:00 to 2013-12-26 10:00:00. 4 instances./ /2013-12-26 11:58:07.138 2389 ERROR nova.openstack.common.periodic_task [-] Error during ComputeManager._instance_usage_audit: Remote error: DBError SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]/ /[u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 471, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1891, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper\n return f(*args, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 5435, in task_log_begin_task\n task.save()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/models.py", line 53, in save\n session.flush()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py", line 543, in _wrap\n raise exception.DBError(e)\n', u"DBError: SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]\n"]./ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task Traceback (most recent call last):/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/periodic_task.py", line 180, in run_periodic_tasks/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task(self, context)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4495, in _instance_usage_audit/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task self.host, num_instances)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 372, in start_instance_usage_audit/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task "Instance usage audit started...")/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 279, in task_log_begin_task/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task_items, message)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 411, in task_log_begin_task/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task task_items=task_items, message=message)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 85, in call/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return self._invoke(self.proxy.call, ctxt, method, **kwargs)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/rpcclient.py", line 63, in _invoke/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return cast_or_call(ctxt, msg, **self.kwargs)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/proxy.py", line 126, in call/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task result = rpc.call(context, real_topic, msg, timeout)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/__init__.py", line 139, in call/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task return _get_impl().call(CONF, context, topic, msg, timeout)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_kombu.py", line 816, in call/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task rpc_amqp.get_connection_pool(conf, Connection))/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 574, in call/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task rv = list(rv)/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 539, in __iter__/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task raise result/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task RemoteError: Remote error: DBError SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]/ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 471, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1891, in task_log_begin_task\n message)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 108, in wrapper\n return f(*args, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 5435, in task_log_begin_task\n task.save()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/models.py", line 53, in save\n session.flush()\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/db/sqlalchemy/session.py", line 543, in _wrap\n raise exception.DBError(e)\n', u"DBError: SQLite DateTime type only accepts Python datetime and date objects as input. (original cause: TypeError: SQLite DateTime type only accepts Python datetime and date objects as input.) 'INSERT INTO task_log (created_at, updated_at, deleted_at, deleted, task_name, state, host, period_beginning, period_ending, message, task_items, errors) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' [{'period_ending': u'2013-12-26T10:00:00.000000', 'state': 'RUNNING', 'updated_at': None, 'host': u'"HOSTNAME"', 'task_items': 4, 'task_name': u'instance_usage_audit', 'period_beginning': u'2013-12-26T09:00:00.000000', 'message': u'Instance usage audit started...', 'deleted_at': None}]\n"]./ /2013-12-26 11:58:07.138 2389 TRACE nova.openstack.common.periodic_task/ /2013-12-26 11:58:07.141 2389 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources/ /2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 35496/ /2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 1689/ /2013-12-26 11:58:07.490 2389 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 2/ /2013-12-26 11:58:07.670 2389 INFO nova.compute.resource_tracker [-] Compute_service record updated for "HOSTNAME":"HOSTNAME"/ / /
_______________________________________________ Community mailing list Community@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/community
-- Ask and answer questions on https://ask.openstack.org
participants (2)
-
Stefano Maffulli
-
Sudarshan Pathak