(aws-glue): failed to create L2 Job
See original GitHub issueWhat is the problem?
tried a switch to the L2 - got this “service”:“AWSGlue”,“statusCode”:400,“errorCode”:“EntityNotFoundException”,“requestId”:“8b148762-2a85-4b0a-bfb7-499ab470356e”,“errorMessage”:“Job with name: batchFiltersJob not found.”,“type”:“AwsServiceError”}
Reproduction Steps
Constructor
const glueJob = new glue.Job(this, props.name, {
executable: glue.JobExecutable.pythonEtl({
glueVersion: glue.GlueVersion.V3_0,
pythonVersion: glue.PythonVersion.THREE,
script: glue.Code.fromBucket(
props.bucket,
`assets-glueJobs/${props.script}`
),
}),
description: `A batchJob for ${props.name}`,
workerType: glue.WorkerType.G_1X,
maxRetries: 1,
timeout: Duration.seconds(2880),
role: props.job_role,
defaultArguments: {
"--TempDir": "s3://glue.zenlist.com/staging",
"--job-bookmark-option": "job-bookmark-enable",
"--job-language": "python",
},
});
What did you expect to happen?
Successful creation of a Glue job
What actually happened?
Creation failed with error message
service":"AWSGlue","statusCode":400,"errorCode":"EntityNotFoundException","requestId":"8b148762-2a85-4b0a-bfb7-499ab470356e","errorMessage":"Job with name: batchFiltersJob not found.","type":"AwsServiceError"}
CDK CLI Version
cdk version 1.125.0 (build 67b4921)
Framework Version
No response
Node.js Version
v14.17.0
OS
arch linux
Language
Typescript
Language Version
Version 4.4.3
Other information
No response
Issue Analytics
- State:
- Created 2 years ago
- Comments:7 (2 by maintainers)
Top Results From Across the Web
Troubleshooting errors in AWS Glue
Solution: set concurrency to 1 or don't run the job concurrently. Currently AWS Glue bookmarks don't support concurrent job runs and commits will...
Read more >Troubleshoot the AWS Glue error "Command failed with exit ...
My AWS Glue extract, transform, and load (ETL) job fails with the error ... the error "Command failed with exit code 1" and...
Read more >Why does my AWS Glue crawler or ETL job fail with the error ...
To resolve this error, grant the Create table permission for example-database to the IAM role that's associated with the crawler/ETL job: Open ...
Read more >Resolve failed test connection in AWS Glue
This issue can be resolved by creating a dedicated AWS Glue VPC and setting up the corresponding VPC peerings with your other VPCs...
Read more >Troubleshoot Glue job not writing logs to CloudWatch
If you haven't turned on continuous logging for your AWS Glue Spark ETL job, then check if the job failed before log aggregation....
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Thank you. Adding the
Worker count
solved the issue. I guess the cdk check could be enhanced but issue is solved⚠️COMMENT VISIBILITY WARNING⚠️
Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.