unit-ceph-osd-9: 18:10:18 INFO juju.worker.uniter awaiting error resolution for "relation-changed" hook
unit-ceph-osd-9: 18:10:19 DEBUG unit.ceph-osd/9.juju-log mon:200: Hardening function 'install'
unit-ceph-osd-9: 18:10:19 DEBUG unit.ceph-osd/9.juju-log mon:200: Hardening function 'config_changed'
unit-ceph-osd-9: 18:10:19 DEBUG unit.ceph-osd/9.juju-log mon:200: Hardening function 'upgrade_charm'
unit-ceph-osd-9: 18:10:19 DEBUG unit.ceph-osd/9.juju-log mon:200: Hardening function 'update_status'
unit-ceph-osd-9: 18:10:19 INFO unit.ceph-osd/9.juju-log mon:200: mon has provided conf- scanning disks
unit-ceph-osd-9: 18:10:22 INFO unit.ceph-osd/9.juju-log mon:200: Making dir /var/lib/charm/ceph-osd ceph:ceph 555
unit-ceph-osd-9: 18:10:23 INFO unit.ceph-osd/9.juju-log mon:200: Monitor hosts are ['10.5.100.112:6789', '10.5.100.115:6789', '10.5.100.122:6789']
unit-ceph-osd-10: 18:10:24 INFO unit.ceph-osd/10.juju-log mon:200: Making dir /srv/osd ceph:ceph 755
unit-ceph-osd-9: 18:10:26 DEBUG unit.ceph-osd/9.juju-log mon:200: got journal devs: set([])
unit-ceph-osd-9: 18:10:27 DEBUG unit.ceph-osd/9.juju-log mon:200: read zapped: set([])
unit-ceph-osd-9: 18:10:27 DEBUG unit.ceph-osd/9.juju-log mon:200: write zapped: set([])
unit-ceph-osd-9: 18:10:27 INFO unit.ceph-osd/9.juju-log mon:200: ceph bootstrapped, rescanning disks
unit-ceph-osd-10: 18:10:29 INFO unit.ceph-osd/10.juju-log mon:200: osdize dir cmd: ['sudo', '-u', 'ceph', 'ceph-disk', 'prepare', '--data-dir', u'/srv/osd']
unit-ceph-osd-9: 18:10:29 INFO unit.ceph-osd/9.juju-log mon:200: Making dir /var/lib/charm/ceph-osd ceph:ceph 555
unit-ceph-osd-9: 18:10:29 INFO unit.ceph-osd/9.juju-log mon:200: Monitor hosts are ['10.5.100.112:6789', '10.5.100.115:6789', '10.5.100.122:6789']
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed got monmap epoch 2
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed ceph-disk: Error: ['ceph-osd', '--cluster', 'ceph', '--mkfs', '--mkkey', '-i', '1', '--monmap', '/srv/osd/activate.monmap', '--osd-data', '/srv/osd', '--osd-journal', '/srv/osd/journal', '--osd-uuid', 'a76afa28-ac93-43d8-a15c-8868dd171b60', '--keyring', '/srv/osd/keyring', '--setuser', 'ceph', '--setgroup', 'ceph'] failed : 2017-01-25 18:10:31.555606 7f5df03638c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed 2017-01-25 18:10:31.555625 7f5df03638c0 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected a76afa28-ac93-43d8-a15c-8868dd171b60, invalid (someone else's?) journal
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed 2017-01-25 18:10:31.555660 7f5df03638c0 -1 filestore(/srv/osd) mkjournal error creating journal on /srv/osd/journal: (22) Invalid argument
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed 2017-01-25 18:10:31.555678 7f5df03638c0 -1 OSD::mkfs: ObjectStore::mkfs failed with error -22
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed 2017-01-25 18:10:31.555714 7f5df03638c0 -1 ** ERROR: error creating empty object store in /srv/osd: (22) Invalid argument
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed Traceback (most recent call last):
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-10/charm/hooks/mon-relation-changed", line 517, in <module>
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed hooks.execute(sys.argv)
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-10/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed self._hooks[hook_name]()
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-10/charm/hooks/mon-relation-changed", line 444, in mon_relation
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed prepare_disks_and_activate()
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-10/charm/hooks/mon-relation-changed", line 358, in prepare_disks_and_activate
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed ceph.start_osds(get_devices())
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "lib/ceph/__init__.py", line 790, in start_osds
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed subprocess.check_call(['ceph-disk', 'activate', dev_or_path])
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed raise CalledProcessError(retcode, cmd)
unit-ceph-osd-10: 18:10:31 INFO unit.ceph-osd/10.mon-relation-changed subprocess.CalledProcessError: Command '['ceph-disk', 'activate', u'/srv/osd']' returned non-zero exit status 1
unit-ceph-osd-10: 18:10:31 ERROR juju.worker.uniter.operation hook "mon-relation-changed" failed: exit status 1
unit-ceph-osd-10: 18:10:31 INFO juju.worker.uniter awaiting error resolution for "relation-changed" hook
unit-ceph-osd-9: 18:10:37 INFO unit.ceph-osd/9.juju-log mon:200: Making dir /srv/osd ceph:ceph 755
unit-ceph-radosgw-3: 18:10:41 INFO juju.worker.leadership ceph-radosgw/3 will renew ceph-radosgw leadership at 2017-01-25 18:11:10.994905096 +0000 UTC
unit-ceph-osd-9: 18:10:43 INFO unit.ceph-osd/9.juju-log mon:200: osdize dir cmd: ['sudo', '-u', 'ceph', 'ceph-disk', 'prepare', '--data-dir', u'/srv/osd']
unit-ceph-osd-10: 18:10:44 INFO juju.worker.leadership ceph-osd/10 will renew ceph-osd leadership at 2017-01-25 18:11:14.092559387 +0000 UTC
unit-ceph-mon-10: 18:10:44 INFO juju.worker.leadership ceph-mon/10 will renew ceph-mon leadership at 2017-01-25 18:11:14.096577242 +0000 UTC
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed got monmap epoch 2
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed ceph-disk: Error: ['ceph-osd', '--cluster', 'ceph', '--mkfs', '--mkkey', '-i', '2', '--monmap', '/srv/osd/activate.monmap', '--osd-data', '/srv/osd', '--osd-journal', '/srv/osd/journal', '--osd-uuid', '5b03c213-4d21-496f-876f-aab537f66741', '--keyring', '/srv/osd/keyring', '--setuser', 'ceph', '--setgroup', 'ceph'] failed : 2017-01-25 18:10:45.065809 7ffb15d2a8c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed 2017-01-25 18:10:45.065828 7ffb15d2a8c0 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected 5b03c213-4d21-496f-876f-aab537f66741, invalid (someone else's?) journal
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed 2017-01-25 18:10:45.065863 7ffb15d2a8c0 -1 filestore(/srv/osd) mkjournal error creating journal on /srv/osd/journal: (22) Invalid argument
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed 2017-01-25 18:10:45.065882 7ffb15d2a8c0 -1 OSD::mkfs: ObjectStore::mkfs failed with error -22
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed 2017-01-25 18:10:45.065918 7ffb15d2a8c0 -1 ** ERROR: error creating empty object store in /srv/osd: (22) Invalid argument
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed Traceback (most recent call last):
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-9/charm/hooks/mon-relation-changed", line 517, in <module>
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed hooks.execute(sys.argv)
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-9/charm/hooks/charmhelpers/core/hookenv.py", line 715, in execute
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed self._hooks[hook_name]()
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-9/charm/hooks/mon-relation-changed", line 444, in mon_relation
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed prepare_disks_and_activate()
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-9/charm/hooks/mon-relation-changed", line 358, in prepare_disks_and_activate
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed ceph.start_osds(get_devices())
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "lib/ceph/__init__.py", line 790, in start_osds
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed subprocess.check_call(['ceph-disk', 'activate', dev_or_path])
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed raise CalledProcessError(retcode, cmd)
unit-ceph-osd-9: 18:10:45 INFO unit.ceph-osd/9.mon-relation-changed subprocess.CalledProcessError: Command '['ceph-disk', 'activate', u'/srv/osd']' returned non-zero exit status 1
unit-ceph-osd-9: 18:10:45 ERROR juju.worker.uniter.operation hook "mon-relation-changed" failed: exit status 1
unit-ceph-osd-9: 18:10:45 INFO juju.worker.uniter awaiting error resolution for "relation-changed" hook