question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

(aws-glue): failed to create L2 Job

See original GitHub issue

What is the problem?

tried a switch to the L2 - got this “service”:“AWSGlue”,“statusCode”:400,“errorCode”:“EntityNotFoundException”,“requestId”:“8b148762-2a85-4b0a-bfb7-499ab470356e”,“errorMessage”:“Job with name: batchFiltersJob not found.”,“type”:“AwsServiceError”}

Reproduction Steps

Constructor

    const glueJob = new glue.Job(this, props.name, {
      executable: glue.JobExecutable.pythonEtl({
        glueVersion: glue.GlueVersion.V3_0,
        pythonVersion: glue.PythonVersion.THREE,
        script: glue.Code.fromBucket(
          props.bucket,
          `assets-glueJobs/${props.script}`
        ),
      }),
      description: `A batchJob for ${props.name}`,
      workerType: glue.WorkerType.G_1X,
      maxRetries: 1,
      timeout: Duration.seconds(2880),
      role: props.job_role,
       defaultArguments: {
         "--TempDir": "s3://glue.zenlist.com/staging",
         "--job-bookmark-option": "job-bookmark-enable",
         "--job-language": "python",
       },
 });

What did you expect to happen?

Successful creation of a Glue job

What actually happened?

Creation failed with error message

service":"AWSGlue","statusCode":400,"errorCode":"EntityNotFoundException","requestId":"8b148762-2a85-4b0a-bfb7-499ab470356e","errorMessage":"Job with name: batchFiltersJob not found.","type":"AwsServiceError"}

CDK CLI Version

cdk version 1.125.0 (build 67b4921)

Framework Version

No response

Node.js Version

v14.17.0

OS

arch linux

Language

Typescript

Language Version

Version 4.4.3

Other information

No response

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
mgabscommented, Oct 13, 2021

Thank you. Adding the Worker count solved the issue. I guess the cdk check could be enhanced but issue is solved

0reactions
github-actions[bot]commented, Oct 13, 2021

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Troubleshooting errors in AWS Glue
Solution: set concurrency to 1 or don't run the job concurrently. Currently AWS Glue bookmarks don't support concurrent job runs and commits will...
Read more >
Troubleshoot the AWS Glue error "Command failed with exit ...
My AWS Glue extract, transform, and load (ETL) job fails with the error ... the error "Command failed with exit code 1" and...
Read more >
Why does my AWS Glue crawler or ETL job fail with the error ...
To resolve this error, grant the Create table permission for example-database to the IAM role that's associated with the crawler/ETL job: Open ...
Read more >
Resolve failed test connection in AWS Glue
This issue can be resolved by creating a dedicated AWS Glue VPC and setting up the corresponding VPC peerings with your other VPCs...
Read more >
Troubleshoot Glue job not writing logs to CloudWatch
If you haven't turned on continuous logging for your AWS Glue Spark ETL job, then check if the job failed before log aggregation....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found