question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Warp IO workload errors out with "The specified key does not exist" on Bare Metal

See original GitHub issue

Environment info

  • NooBaa Version:
[root@hpo-app11 ~]# noobaa version
INFO[0000] CLI version: 5.10.1
INFO[0000] noobaa-image: noobaa/noobaa-core:5.10.1
INFO[0000] operator-image: noobaa/noobaa-operator:5.10.1
[root@hpo-app11 ~]#
  • Platform:
[root@hpo-app11 ~]# oc version
Client Version: 4.11.0
Kustomize Version: v4.5.4
Server Version: 4.11.0
Kubernetes Version: v1.24.0+9546431
[root@hpo-app11 ~]#

ODF Version

[root@hpo-app11 ~]# oc get csv
NAME                                   DISPLAY                       VERSION               REPLACES                          PHASE
mcg-operator.v4.11.1                   NooBaa Operator               4.11.1                mcg-operator.v4.11.0              Succeeded
metallb-operator.4.11.0-202208300306   MetalLB Operator              4.11.0-202208300306                                     Succeeded
ocs-operator.v4.11.1                   OpenShift Container Storage   4.11.1                ocs-operator.v4.11.0              Succeeded
odf-csi-addons-operator.v4.11.1        CSI Addons                    4.11.1                odf-csi-addons-operator.v4.11.0   Succeeded
odf-operator.v4.11.1                   OpenShift Data Foundation     4.11.1                odf-operator.v4.11.0              Succeeded
[root@hpo-app11 ~]#

Warp version:

[root@hpo-app11 ~]# warp --version
warp version 0.5.5 - 1baadbc
[root@hpo-app11 ~]#

Actual behavior

warp run on Bare Metal fails on all three metallb Endpoints

Expected behavior

warp should execute successfully

Steps to reproduce

  1. Setup BM with CNSA/CSI RC4, ODF 4.11.1, latest DAS operator.
  2. Run warp on all three metallb IPs with 3 different users:

warp mixed --host=10.49.0.109 --access-key=uIBpl5fBWanFrXxLY6JW --secret-key=Z658YPATWG491XEbnn9ZwCPUGUS8KS36m91zWhUO --obj.size=1K --duration=120m --bucket=bucket11 --debug --insecure --tls 1> capture1.txt 2> error1.txt

warp mixed --host=10.49.0.110 --access-key=lDW9JSyitHuYa0EGx6vM --secret-key=BAu2KPpbAct28rvYwCdjILkO1vNWphsO57H5htlD --obj.size=1K --duration=120m --bucket=bucket22 --debug --insecure --tls 1> capture2.txt 2> error2.txt

warp mixed --host=10.49.0.111 --access-key=8FnXjkMLesfOOOr4TKw6 --secret-key=OjcPkdOyTE6FDujcmBj3JeUVl11TpZznyj4GyVhe --obj.size=1M --duration=120m --bucket=bucket33 --debug --insecure --tls 1> capture3.txt 2> error3.txt

Attachments: capture2.txt capture3.txt capture1.txt error1.txt error2.txt error3.txt

Logs: https://ibmandredhatguests.slack.com/archives/G015Z7SDWQ0/p1663598668494769?thread_ts=1663597420.548999&cid=G015Z7SDWQ0

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:29 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
nigamshaurya14commented, Oct 19, 2022

@romayalon it is just an update for what was tried yesterday as per discussion in the call. we will run with other object sizes as well to make sure that the bug is fixed. I will definately share the logs in the final update.

0reactions
romayaloncommented, Nov 8, 2022

https://github.com/noobaa/noobaa-core/pull/7101 backport PR to 4.12 I’ll update regarding 4.11 when we will have more details

Read more comments on GitHub >

github_iconTop Results From Across the Web

Issues · noobaa/noobaa-core - GitHub
NooBaa is a Dynamic Data Gateway for cloud-native, ... Warp IO workload errors out with "The specified key does not exist" on Bare...
Read more >
Accelerating Bare Metal Kubernetes Workloads, the Right Way
A key takeaway from this post was the current rapid shift toward bare metal Kubernetes, for delivering high-performance workloads across ...
Read more >
ADSM Client Disaster Recovery: Bare Metal Restore
recovery of the ADSM client environment from the bare metal up, including ... the archive function does not have a concept of versioning....
Read more >
E-WarP: A System-wide Framework ... - CS-People by full name
general purpose workload, the same cannot be stated for safety-critical systems. ... In the E-WarP methodology, the profiler plays a key role to....
Read more >
Understanding the Interactions of Workloads and DRAM Types
02/20/19 - It has become increasingly difficult to understand the complex interaction between modern applications and main memory, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found