question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Error on first use of S3 Backend

See original GitHub issue

Describe the bug When running for the first time an existing Julie setup, after adding an S3Backend, I get an error that clearly says that the state file doesn’t exist yet in s3.

Error:  2022-03-04 08:43:22.094 [main] S3Backend - software.amazon.awssdk.services.s3.model.NoSuchKeyException: The specified key does not exist. (Service: S3, Status Code: 404, Request ID: XXXXXXX, .....)

To Reproduce Add an S3Backend to a Julie setup that didn’t have one before.

topology.builder.state.processor.class=com.purbon.kafka.topology.backend.S3Backend
julie.s3.region=eu-central-1
julie.s3.bucket=mybucket

Expected behavior The backend should create an initial state based on the Julie config instead of failing to initiate

Additional context This looks similar to the other issue I created with the Redis backend. It doesn’t seem to be able to handle initial run and needs an existing state before it can work https://github.com/kafka-ops/julie/issues/453

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:12

github_iconTop GitHub Comments

1reaction
samudurandcommented, Mar 25, 2022

You are very welcome, Julie is a great tool!

0reactions
purboncommented, Mar 25, 2022

I tried with a real S3, with the bucket created, but empty. After the test, no error where spoted and

  aws s3 ls s3://pere.julie.ops
2022-03-25 10:31:18       1199 .cluster-state
 pere@fuchsi  ~/work/gitops/kafka-topology-builder   issue-454 ●✚ 

closing this issue for now, feel free to reopen if necessary.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Error while configuring Terraform S3 Backend - Stack Overflow
When running the terraform init you have to add -backend-config options for your credentials (aws keys). So your command should look like:.
Read more >
Bad S3 Backend Configuration Cannot Be Fixed #23532
The error is output to the console but not recorded in the log, and crucially it does not log the name of the...
Read more >
Confusing error message when terraform backend is changed
I am using s3 as terraform backend to manage AWS resources, and recently I enabled SSO for AWS by adding a SSO profile...
Read more >
How to fix-error configuring S3 Backend no valid credential ...
1. Reconfigure the AWS CLI with correct Access Key and Secret Key. The most probably cause of this issue is you are using...
Read more >
Reason: Initial configuration of the requested backend "s3"
I am to new to devops in general, Just playing around with CI/CD Pipeline free versions, Circleci terraform destroy throwing me below error....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found