question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support for AWS MSK IAM authorization

See original GitHub issue

Hi! We are looking at using Strimzi to deploy Kafka Connect clusters using Kafka brokers deployed using Amazon MSK. We’d like to use MSK’s IAM feature for access control within the Kafka cluster (https://docs.aws.amazon.com/msk/latest/developerguide/iam-access-control.html), and I was curious how we could enable this when deploying Kafka Connect clusters using Strimzi.

The MSK docs say Kafka clients need to be configured with the following properties:

ssl.truststore.location=<PATH_TO_TRUST_STORE_FILE>
security.protocol=SASL_SSL
sasl.mechanism=AWS_MSK_IAM
sasl.jaas.config=software.amazon.msk.auth.iam.IAMLoginModule required;
sasl.client.callback.handler.class=software.amazon.msk.auth.iam.IAMClientCallbackHandler

and the client requires the aws-msk-iam-auth plugin. This is fine because I can build an image for Strimzi containing this plugin.

The problem is, according to the Strimzi docs, there are specific ways to configure authn/authz and although the SASL_SSL protocol is supported, there doesn’t seem to be a way to configure the sasl.mechanism and other options. I also cannot configure these manually in the KafkaConnect CR .spec.config because the docs suggest that any ssl., security. or sasl. are ignored in that block. Is there any other way we can configure these options with Strimzi?

Issue Analytics

  • State:open
  • Created 2 years ago
  • Reactions:15
  • Comments:20 (10 by maintainers)

github_iconTop GitHub Comments

9reactions
Anthuangcommented, Sep 13, 2021

Hey, we’re looking for the same functionality as @prydonius, and are considering to contribute support for it.

Curious what the work looks like to add support for this (and if possible could you point us in the right direction)?

Much appreciated!

2reactions
fjbecerracommented, Mar 16, 2022

Hey, If this is ready for development, I’d like to give it a go, @scholzj assign it to me please!

Read more comments on GitHub >

github_iconTop Results From Across the Web

IAM access control - Amazon Managed Streaming for Apache ...
IAM access control for Amazon MSK enables you to handle both authentication and authorization for your MSK cluster. This eliminates the need to...
Read more >
aws/aws-msk-iam-auth: Enables developers to use ... - GitHub
Enables developers to use AWS Identity and Access Management (IAM) to connect to their Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters....
Read more >
Authentication and authorization for Amazon MSK APIs
Amazon Identity and Access Management (IAM) is an Amazon Web Service that helps an administrator securely control access to Amazon resources. IAM administrators ......
Read more >
Unable to use IAM permissions to access MSK Brokers
I have been experimenting with a cluster that has IAM Authentication, and I cannot seem to get it ... Amazon Managed Streaming for...
Read more >
Debezium With AWS MSK IAM Authentication - The Data Guy
AWS MSK now supports Kafka ACL via IAM permissions. You can assign that permission to an IAM user( aws credentials file ) or...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found