(aws-glue): Job construct
See original GitHub issueIn https://github.com/aws/aws-cdk/issues/5172 and its PRs, the suggestion was made to break a PR down into 2
- Add Connection construct
- Add Job construct
I’ve since had a look and realized the work needed involves 3 constructs
Since the original issue and PR have gone without progress for a time, I am contributing some effort here and as such will be creating 3 issues and hopefully 3 PRs to address each of the issues.
This is the first issue; to add the Glue Job
construct
Use Case
Be able to create Glue jobs with L2 constructs that utilize Glue connections. My immediate use case is to be able to connect data sources in a VPC
Proposed Solution
Introduce a Job
L2 construct wrapping the Glue Job CloudFormation resource
- 👋 I may be able to implement this feature request
- ⚠️ This feature might incur a breaking change
This is a 🚀 Feature Request
Issue Analytics
- State:
- Created 3 years ago
- Reactions:1
- Comments:7 (4 by maintainers)
Top Results From Across the Web
create-job — AWS CLI 1.27.37 Command Reference
The number of Glue data processing units (DPUs) to allocate to this Job. ... Specifies the column definitions that make up a Glue...
Read more >Adding jobs in AWS Glue
An AWS Glue job encapsulates a script that connects to your source data, processes it, and then writes it out to your data...
Read more >class Job (construct) · AWS CDK - AWS Documentation
Create a CloudWatch Event Rule for this Glue Job when it's in a given state. onFailure(id, options?) , Return a CloudWatch Event...
Read more >CreateJob - AWS Glue
Creates a new job definition. ... pairs that AWS Glue consumes to set up your job, see the Special Parameters Used by AWS...
Read more >Working with jobs on the AWS Glue console
A job in AWS Glue consists of the business logic that performs extract, transform, and load (ETL) work. You can create jobs in...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@iliapolo I’d say either Connection or SecurityConfiguration are good to start with, or even both in parallel as they’re independent.
Job has dependencies on both, so for it to be complete both PRs will have to be merged first. It’s currently kinda complete but for using them and I anticipate it will take some reviewing/discussion as it’s not a small one.
⚠️COMMENT VISIBILITY WARNING⚠️
Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.