Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Unable to install Ceph Monitor

See original GitHub issue

Git clone today, switched to stable 4.0. No major changes to the .yml files

Running ansible-playbook produces the following error and looks like a typo for mon.keyring with a double stop.

fatal: [stor1]: FAILED! => changed=true 
  cmd:
  - ceph-mon
  - --cluster
  - ceph
  - --setuser
  - ceph
  - --setgroup
  - ceph
  - --mkfs
  - -i
  - stor1
  - --fsid
  - e6bfd1ef-428a-4cc1-b835-b622c95b6be5
  - --keyring
  - /var/lib/ceph/tmp/ceph.mon..keyring
  delta: '0:00:00.071556'
  end: '2019-09-01 20:38:19.599356'
  invocation:
    module_args:
      _raw_params: |-
        ceph-mon --cluster ceph --setuser "ceph" --setgroup "ceph" --mkfs -i stor1 --fsid e6bfd1ef-428a-4cc1-b835-b622c95b6be5 **--keyring /var/lib/ceph/tmp/ceph.mon..keyring**
      _uses_shell: false
      argv: null
      chdir: null
      creates: /var/lib/ceph/mon/ceph-stor1/keyring
      executable: null
      removes: null
      stdin: null
      stdin_add_newline: true
      strip_empty_ends: true
      warn: true
  msg: non-zero return code
  rc: -6
  start: '2019-09-01 20:38:19.527800'
  stderr: |-
    /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7f8bb7290180 time 2019-09-01 20:38:19.593527
    /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f8bae528046]
     2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     3: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     7: (main()+0x2b51) [0x55ddb0803571]
     8: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     9: (()+0x284f10) [0x55ddb08f4f10]
    2019-09-01 20:38:19.594 7f8bb7290180 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7f8bb7290180 time 2019-09-01 20:38:19.593527
    /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f8bae528046]
     2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     3: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     7: (main()+0x2b51) [0x55ddb0803571]
     8: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     9: (()+0x284f10) [0x55ddb08f4f10]
  
    *** Caught signal (Aborted) **
     in thread 7f8bb7290180 thread_name:ceph-mon
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (()+0xf5d0) [0x7f8bab1295d0]
     2: (gsignal()+0x37) [0x7f8ba9f202c7]
     3: (abort()+0x148) [0x7f8ba9f219b8]
     4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f8bae528095]
     5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     6: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     7: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     8: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     9: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     10: (main()+0x2b51) [0x55ddb0803571]
     11: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     12: (()+0x284f10) [0x55ddb08f4f10]
    2019-09-01 20:38:19.596 7f8bb7290180 -1 *** Caught signal (Aborted) **
     in thread 7f8bb7290180 thread_name:ceph-mon
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (()+0xf5d0) [0x7f8bab1295d0]
     2: (gsignal()+0x37) [0x7f8ba9f202c7]
     3: (abort()+0x148) [0x7f8ba9f219b8]
     4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f8bae528095]
     5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     6: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     7: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     8: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     9: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     10: (main()+0x2b51) [0x55ddb0803571]
     11: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     12: (()+0x284f10) [0x55ddb08f4f10]
     NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  
        -1> 2019-09-01 20:38:19.594 7f8bb7290180 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7f8bb7290180 time 2019-09-01 20:38:19.593527
    /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f8bae528046]
     2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     3: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     7: (main()+0x2b51) [0x55ddb0803571]
     8: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     9: (()+0x284f10) [0x55ddb08f4f10]
  
         0> 2019-09-01 20:38:19.596 7f8bb7290180 -1 *** Caught signal (Aborted) **
     in thread 7f8bb7290180 thread_name:ceph-mon
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (()+0xf5d0) [0x7f8bab1295d0]
     2: (gsignal()+0x37) [0x7f8ba9f202c7]
     3: (abort()+0x148) [0x7f8ba9f219b8]
     4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f8bae528095]
     5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     6: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     7: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     8: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     9: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     10: (main()+0x2b51) [0x55ddb0803571]
     11: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     12: (()+0x284f10) [0x55ddb08f4f10]
     NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  
        -1> 2019-09-01 20:38:19.594 7f8bb7290180 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7f8bb7290180 time 2019-09-01 20:38:19.593527
    /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f8bae528046]
     2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     3: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     7: (main()+0x2b51) [0x55ddb0803571]
     8: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     9: (()+0x284f10) [0x55ddb08f4f10]
  
         0> 2019-09-01 20:38:19.596 7f8bb7290180 -1 *** Caught signal (Aborted) **
     in thread 7f8bb7290180 thread_name:ceph-mon
  
     ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable)
     1: (()+0xf5d0) [0x7f8bab1295d0]
     2: (gsignal()+0x37) [0x7f8ba9f202c7]
     3: (abort()+0x148) [0x7f8ba9f219b8]
     4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f8bae528095]
     5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f8bae528214]
     6: (MonMap::add(mon_info_t const&)+0x1da) [0x7f8bae89a85a]
     7: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x108) [0x7f8bae89a978]
     8: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xd1) [0x7f8bae8934f1]
     9: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x26d) [0x7f8bae89837d]
     10: (main()+0x2b51) [0x55ddb0803571]
     11: (__libc_start_main()+0xf5) [0x7f8ba9f0c495]
     12: (()+0x284f10) [0x55ddb08f4f10]
     NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>

CentOS 7
Ansible 2.8

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:11 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
dsavineaucommented, Aug 27, 2020

I try to set monitor_address in inventory, and monitor_interface in group_vars/all.yml without luck

Using monitor_address and monitor_interface variables at the same time doesn’t make sense. You only need one of them.

  • with monitor_address variable:
  1. with the ansible inventory
[mons]
mon0 monitor_address=192.168.1.10
mon1 monitor_address=192.168.1.11
mon2 monitor_address=192.168.1.12
  1. with the host vars
$ grep monitor_address host_vars -r
host_vars/mon0.yml:monitor_address: 192.168.1.10
host_vars/mon1.yml:monitor_address: 192.168.1.11
host_vars/mon2.yml:monitor_address: 192.168.1.12
  • with monitor_interface variable:
[mons]
mon0 monitor_interface=eth0
mon1 monitor_interface=eth3
mon2 monitor_interface=tun2
  1. with the host vars
$ grep monitor_interface host_vars -r
host_vars/mon0.yml:monitor_interface: eth0
host_vars/mon1.yml:monitor_interface: eth3
host_vars/mon2.yml:monitor_interface: tun2
  1. with the group vars (if the interface is the same on all mons)
$ grep monitor_interface group_vars -r
group_vars/all.yml:monitor_interface: eth0

Finally be sure to have the IP address from monitor_address or configured on monitor_interface part of the public_network cidr

1reaction
JinxCappacommented, Apr 14, 2020

I was having this same issue and for me in my config I didn’t set the monitor_address variable. Instead I only had set the interface and block variables. When I commented those two out and set the monitor_address, the installation skipped the [ ceph monitor mkfs without keyring ] task that was giving me this error. Thanks to dengchj for answer.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Chapter 4. Troubleshooting Ceph Monitors Red Hat Ceph ...
If the Ceph Monitor is in the probing state longer than expected, it cannot find the other Ceph Monitors. This problem can be...
Read more >
Troubleshooting Monitors - Ceph Documentation
First of all, we need to make sure the monitor (mon) daemon processes ( ceph-mon ) are running. You would be amazed by...
Read more >
6 Troubleshooting Ceph Monitors and Ceph Managers
If the Ceph Monitors cannot form a quorum, cephadm will not be able to manage the cluster until ... Some OS install utilities...
Read more >
Not able to deploy CEPH monitor - Stack Overflow
The machines are all identical with CentOS7 64bit. I install ceph on all of them, and ceph deploy on node one. I installed...
Read more >
Unable to add initial monitor to Ceph in Ubuntu - Server Fault
especially, check out file&dir. in /var/lib/ceph/mon directory. If you execute ceph-deploy command as root user, may be created /var/lib/ ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

''osd_memory_target'' in section ''osd'' redefined Error during FSID fetch

Next page

Unable to build a ceph-ansible environment