question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

(aws-glue): Job construct

See original GitHub issue

In https://github.com/aws/aws-cdk/issues/5172 and its PRs, the suggestion was made to break a PR down into 2

  1. Add Connection construct
  2. Add Job construct

I’ve since had a look and realized the work needed involves 3 constructs

  1. Connection construct #12442
  2. SecurityConfiguration construct #12449
  3. Job construct (this request)

Since the original issue and PR have gone without progress for a time, I am contributing some effort here and as such will be creating 3 issues and hopefully 3 PRs to address each of the issues.

This is the first issue; to add the Glue Job construct

Use Case

Be able to create Glue jobs with L2 constructs that utilize Glue connections. My immediate use case is to be able to connect data sources in a VPC

Proposed Solution

Introduce a Job L2 construct wrapping the Glue Job CloudFormation resource

  • 👋 I may be able to implement this feature request
  • ⚠️ This feature might incur a breaking change

This is a 🚀 Feature Request

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
humanzzcommented, Jan 15, 2021

@iliapolo I’d say either Connection or SecurityConfiguration are good to start with, or even both in parallel as they’re independent.

Job has dependencies on both, so for it to be complete both PRs will have to be merged first. It’s currently kinda complete but for using them and I anticipate it will take some reviewing/discussion as it’s not a small one.

0reactions
github-actions[bot]commented, Sep 8, 2021

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.

Read more comments on GitHub >

github_iconTop Results From Across the Web

create-job — AWS CLI 1.27.37 Command Reference
The number of Glue data processing units (DPUs) to allocate to this Job. ... Specifies the column definitions that make up a Glue...
Read more >
Adding jobs in AWS Glue
An AWS Glue job encapsulates a script that connects to your source data, processes it, and then writes it out to your data...
Read more >
class Job (construct) · AWS CDK - AWS Documentation
Create a CloudWatch Event Rule for this Glue Job when it's in a given state. onFailure(id, options?) , Return a CloudWatch Event...
Read more >
CreateJob - AWS Glue
Creates a new job definition. ... pairs that AWS Glue consumes to set up your job, see the Special Parameters Used by AWS...
Read more >
Working with jobs on the AWS Glue console
A job in AWS Glue consists of the business logic that performs extract, transform, and load (ETL) work. You can create jobs in...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found