MultipartUpload doesn't seem to work with KMS Encryption

Problem description

Trying to do a MultipartUpload doesn’t seem to work when using a KMS key.

“errorMessage”: “the bucket ‘BUCKET’ does not exist, or is forbidden for access (ClientError(‘An error occurred (KMS.NotFoundException) when calling the CreateMultipartUpload operation: Invalid keyId [’))”,

Steps/code to reproduce the problem

The code used was this:

config = boto3.session.Config(signature_version='s3v4')

with smart_open.open(url, 'r', transport_params={
                'session':                      SESSION,
                'resource_kwargs': {
                    'config':                   config
                },
                'multipart_upload_kwargs': {
                    'ServerSideEncryption':     'aws:kms',
                    'SSEKMSKeyId':              KEY_id
                }
            })

works for a normal upload only.

[joao-miranda]

@mpenkov Everything works after the update. Sorry about wasting your time.

[joao-miranda]

I did a new test project with smart_open 3.0 and it seems to work. I’ll get back to you after testing it on the actual project:

def main(event, context):
    session = boto3.Session()
    config = boto3.session.Config(signature_version='s3v4')
                    
    with smart_open.open(outputFileUrl, 'w', transport_params={
        'session': session,
                'resource_kwargs': {
                    'config': config
                },
                'multipart_upload_kwargs': {
                    'ServerSideEncryption': 'aws:kms',
                    'SSEKMSKeyId': KMS_ID
                }
            }
        ) as outputFile:
        with smart_open.open(inputFileurl, 'r', transport_params={
                'session': session,
                'resource_kwargs': {
                    'config': config
                },
                'multipart_upload_kwargs': {
                    'ServerSideEncryption': 'aws:kms',
                    'SSEKMSKeyId': KMS_ID
                }
            }
        ) as file:
            chunkCount = 0
            for chunk in iter(functools.partial(file.read, SIZE), ''):
                outputFile.write(chunk)
                print('chunk', chunk)

        print('Created file with url', outputFileUrl)```