(pipelines): Need a way to get Stack Outputs as file artifact if they are > 1000 chars

What is the problem?

It looks like CodeBuildStep.envFromCfnOutputs property is limited to 1-1000 characters. When injecting variables, it can quickly reaches this limit and the CodePipeline build fails with:

8:35:20 AM | CREATE_FAILED        | AWS::CodePipeline::Pipeline                  | ##############
ActionConfiguration Map value must satisfy constraint: [Member must have length less than or equal to 1000, Member must have length greater than or equal to 1] (Service: AWSCodePipeline; Status Code: 400; Error Code: ValidationException; Request ID: ############; Proxy: null)

Reproduction Steps

Include many environment variables from CloudFormation output in CodeBuildStep.envFromCfnOutputs.

What did you expect to happen?

CodeBuildStep successful.

What actually happened?

CodeBuildStep failure with too vague error message.

CDK CLI Version

1.127.0

Framework Version

No response

Node.js Version

14.x

OS

macOS 11.6

Language

Typescript

Language Version

No response

Other information

No response

[piotrekwitkowski]

I use the following workaround:

CodeBuildStep('StepId',
    commands=[
        'aws sts get-caller-identity', # you don't need this but it prints out the role for debugging purposes
        'export MY_VAR=$(aws cloudformation describe-stacks --query "Stacks[?StackName==\'stack-name\'][].Outputs[?OutputKey==\'my-output-key\'].OutputValue" --output text)',
        'echo $MY_VAR'
    ],
    role_policy_statements=[
        PolicyStatement(
            actions=['cloudFormation:DescribeStacks'],
            resources=['*'],
        ),
    ]
)

[brennadotdev]

I’ve run in to this as well, but only in one specific AWS account. I use the same CDK code in other accounts and it works as expected. I’m not sure what the difference is yet since they all have the same number of variables in the build step and reference SSM params of the same names.