question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

aws_kinesisanalytics: Configuring a vpc

See original GitHub issue

Description

Hey,

I have looked thoroughly through aws cdk documentation but couldn’t find any way to configure a Kinesis Data Analytics Application with a VPC.

Is there a way to configure the networking of a Kinesis Data Analytics Application (adding vpc + subnets + security group)?

Use Case

This feature is needed in our use case to allow access for the Flink java application to access resources within our VPC. Say we needed to communicate with AmazonMQ that resides in a private subnet, how would our Kinesis Data Analytics Application reach the queue server?

Proposed Solution

I am not sure how this could be implemented but as an end goal I could see a parameter within the aws_kinesisanalytics.CfnApplicationV2.ApplicationConfigurationProperty Object as such:

networking_configuration_property of type:

aws_kinesisanalytics.CfnApplicationV2.NetworkingConfigurationProperty

that accepts the follwing:

vpc:ec2.VPC,
subnets:[ec2.Subnet],
security_group:ec2.SecurityGroup

Other information

I am not certain this is relevant but: I am using Python: 3.6.8 cdk: 1.129.0 (build fb43f89) the issue I based my work upon: https://github.com/aws/aws-cdk/issues/12407 The PR that addressed the above issue: https://github.com/aws/aws-cdk/pull/12464

related to the above but on another note: I found a bug in a generated example under the following construct:

aws_cdk.aws_kinesisanalytics_flink
_# Example automatically generated without compilation. See https://github.com/aws/jsii/issues/826
import aws_cdk.aws_kinesisanalytics_flink as flink

flink_app = flink.Application(self, "Application",
    # ...
    property_groups=PropertyGroups(
        FlinkApplicationProperties={
            "input_stream_name": "my-input-kinesis-stream",
            "output_stream_name": "my-output-kinesis-stream"
        }
    )
)_

In Python ‘PropertyGroups’ is an abstract class that doesn’t accept any params: https://docs.aws.amazon.com/cdk/api/latest/python/aws_cdk.aws_kinesisanalytics_flink/PropertyGroups.html

Acknowledge

  • I may be able to implement this feature request
  • This feature might incur a breaking change

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
JoeKodsi-Idealworkscommented, Nov 11, 2021

I’ve created a new issue for this in the jsii repo, let’s see what they say

Hey @peterwoodworth great to hear! I guess then this feature-request/issue can be closed and one could follow the outcome here: https://github.com/aws/jsii/issues/3154

If you agree, this ticket can be closed when you see fit.

Thanks again for all the support Cheers!

0reactions
github-actions[bot]commented, Nov 11, 2021

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Configuring Kinesis Data Analytics for Apache Flink to access ...
You can configure a Kinesis Data Analytics application to connect to private subnets in a virtual private cloud (VPC) in your account.
Read more >
Internet and Service Access for a VPC-Connected Kinesis ...
The Kinesis Data Analytics application should only be configured with private subnets. The VPC must contain a NAT gateway or instance in a...
Read more >
Kinesis Data Analytics VPC API - AWS Documentation
Use the AddApplicationVpcConfiguration action to add a VPC configuration to your application after it has been created. The following example request code for ......
Read more >
VPC Application Permissions - Amazon Kinesis Data Analytics
This section describes the permission policies your application will need to work with your VPC. For more information about using permissions policies, ...
Read more >
AddApplicationVpcConfiguration - Kinesis Data Analytics
Adds a Virtual Private Cloud (VPC) configuration to the application. Applications can use VPCs to store and access resources securely.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found