question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Failed to deploy containers on ceph storage

See original GitHub issue

Description When I try to import LXD image from LinuxContainers.org marketplace, disk creation to ceph datastore fails.

Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: cp: Copying local image "lxd://https://images.linuxcontainers.org/images/ubuntu/xenial/amd64/default/./20190227_08:06$
Wed Feb 27 15:33:20 2019 [Z0][ImM][E]: cp: Command "    set -e -o pipefail
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]:
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: FORMAT=$(qemu-img info /var/tmp/b857d240deee8b8b421b172755a19321 | grep "^file format:" | awk '{print $3}' || :)
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]:
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: if [ "$FORMAT" != "raw" ]; then
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: qemu-img convert -O raw /var/tmp/b857d240deee8b8b421b172755a19321 /var/tmp/b857d240deee8b8b421b172755a19321.raw
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: mv /var/tmp/b857d240deee8b8b421b172755a19321.raw /var/tmp/b857d240deee8b8b421b172755a19321
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: fi
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]:
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: rbd --id libvirt import --image-format 2 /var/tmp/b857d240deee8b8b421b172755a19321 one/one-597
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]:
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: # remove original
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: rm -f /var/tmp/b857d240deee8b8b421b172755a19321" failed: rbd: unable to get size of file/block device
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: Importing image: 0% complete...failed.
Wed Feb 27 15:33:20 2019 [Z0][ImM][I]: rbd: import failed: (25) Inappropriate ioctl for device
Wed Feb 27 15:33:20 2019 [Z0][ImM][E]: Error registering one/one-597 in r620-4
Wed Feb 27 15:33:20 2019 [Z0][ImM][E]: Error copying image in the datastore: Error registering one/one-597 in r620-4

To Reproduce Setup LXD node and Linuxcontainer marketplace, try to import container to ceph datastore.

Expected behavior Container image is created to ceph datastore

Details

  • Affected Component: Sunstone, Storage
  • Hypervisor: LXD
  • Version: 5.8.0
  • Ubuntu Xenial

Additional context I did install LXD node package to existing KVM node with ceph backend and reimported host with alternative name as LXD node:

echo "deb http://archive.ubuntu.com/ubuntu $(lsb_release -cs)-backports main restricted universe multiverse" >> /etc/apt/sources.list
apt update
apt install lxd=3.0.3-0ubuntu1~16.04.1 liblxc1=3.0.3-0ubuntu1~16.04.1 lxcfs=3.0.3-0ubuntu1~16.04.1 lxd-client=3.0.3-0ubuntu1~16.04.1 -y
apt-get install opennebula-node-lxd rbd-nbd -y

Ceph datastore info:

onedatastore show 101
DATASTORE 101 INFORMATION
ID             : 101
NAME           : cephds
USER           : oneadmin
GROUP          : oneadmin
CLUSTERS       : 0
TYPE           : IMAGE
DS_MAD         : ceph
TM_MAD         : ceph
BASE PATH      : /var/lib/one//datastores/101
DISK_TYPE      : RBD
STATE          : READY

DATASTORE CAPACITY
TOTAL:         : 11.4T
FREE:          : 5.1T
USED:          : 6.3T
LIMIT:         : -

PERMISSIONS
OWNER          : um-
GROUP          : u--
OTHER          : ---

DATASTORE TEMPLATE
ALLOW_ORPHANS="YES"
BRIDGE_LIST="r620-5 r620-4"
CEPH_HOST="192.168.30.71:6789 192.168.30.72:6789 192.168.30.73:6789"
CEPH_SECRET="********"
CEPH_USER="libvirt"
CLONE_TARGET="SELF"
DATASTORE_CAPACITY_CHECK="YES"
DISK_TYPE="RBD"
DRIVER="raw"
DS_MAD="ceph"
LABELS="Ceph,HDD"
LN_TARGET="NONE"
POOL_NAME="one"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp /tmp /mnt/ceph/appmarket"
TM_MAD="ceph"
TYPE="IMAGE_DS"

Progress Status

  • Branch created
  • Code committed to development branch
  • Testing - QA
  • Documentation
  • Release notes - resolved issues, compatibility, known issues
  • Code committed to upstream release/hotfix branches
  • Documentation committed to upstream release/hotfix branches

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:30 (14 by maintainers)

github_iconTop GitHub Comments

1reaction
tkaldcommented, Mar 1, 2019

And we have a boot with 4.15 kernel 😃

0reactions
dann1commented, Mar 12, 2019

I’ve added the kernel and luminous requirement to the doc, if the marketplace import issue persists, feel free to open another issue. Thanks for the feedback.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Ceph - RGW process/container fails to start after deploying ...
Issue. After deploying Ceph Object Gateway RGW container (or service for non-containerized deployments) is missing.
Read more >
» Cephadm » Troubleshooting - Ceph Documentation
Troubleshooting . You might need to investigate why a cephadm command failed or why a certain service no longer runs properly.
Read more >
Deployment Fails With "Fetching Ceph Keyrings … No JSON ...
If Ceph is enabled, a deployment can fail during the Fetching Ceph keyrings task with the error No JSON object could be decoded...
Read more >
SES 7.1 | Troubleshooting Guide | Troubleshooting cephadm
CLI commands but the previously deployed daemon containers will continue to exist and ... To access the logs of Ceph daemons in SUSE...
Read more >
Kubernetes
Kubernetes, also known as K8s, is an open-source system for automating deployment, scaling, and management of containerized applications.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found