[core] Multiple projects breaks CDK synth (using instanceof cross-project)

❓ General Issue

Creating a Construct, shared by multiple stacks, in a separate project, fails to deploy in CDK version >= 1.57.0

In our setup we have multiple stacks sharing misc. Constructs. These Constructs are all in separate Typescript/NodeJS projects. We use Lerna to maintain/link dependencies between projects.

A simplified example of the structure could be:

➜ tree
.
├── README.md
├── lerna.json
├── package-lock.json
├── package.json
└── packages
    ├── myapp
    │   ├── README.md
    │   ├── bin
    │   │   └── myapp.ts
    │   ├── cdk.json
    │   ├── jest.config.js
    │   ├── lambda
    │   │   └── index.ts
    │   ├── lib
    │   │   └── myapp-stack.ts
    │   ├── package-lock.json
    │   ├── package.json
    │   ├── test
    │   │   └── myapp.test.ts
    │   └── tsconfig.json
    └── myconstruct
        ├── README.md
        ├── jest.config.js
        ├── lambda
        │   └── index.ts
        ├── lib
        │   └── index.ts
        ├── package-lock.json
        ├── package.json
        ├── test
        │   └── myconstruct.test.ts
        └── tsconfig.json

(an example can be found here: https://github.com/gwriss/upgrade_bug)

Running

➜ npx lerna bootstrap

will npm-install all dependencies and link projects like this (snipped for better overview):

➜ tree -L 4
.
├── ...
└── packages
    ├── myapp
    │   ├── ...
    │   ├── node_modules
    │   │   ├── ...
    │   │   ├── @aws-cdk
    │   │   ├── ...
    │   │   ├── myconstruct -> ../../myconstruct
    │   │   └── ...
    │   └── ...
    └── myconstruct
        ├── ...
        ├── node_modules
        │   ├── ...
        │   ├── @aws-cdk
        │   └── ...
        └── ...

Now, when the Construct in myconstruct contains a Lambda Function and the Myapp in myapp instantiate an instance of Myconstruct, the synth of the app fails:

➜ npx lerna run build
lerna notice cli v3.22.1
...
...
lerna success - myapp
lerna success - myconstruct
➜ cd packages/myapp
➜ npx cdk synth
unable to determine cloud assembly output directory. Assets must be defined indirectly within a "Stage" or an "App" scope
Subprocess exited with error 1

(an example of the setup can be found and tested here: https://github.com/gwriss/upgrade_bug)

Diving into the problem, it seems like it’s another issue with instanceof comparing two instances of the same class, but from different node_modules.

I think @tneely was onto something in https://github.com/aws/aws-cdk/issues/9546#issuecomment-671064704, but decided to close the issue without a resolution.

Another issued related to this is the “Duck Typing” fix of Stack in https://github.com/aws/aws-cdk/issues/10671.

⚠️ Notice Please don’t pollute the discussion with suggestions about “deleting node_modules & reinstall” and “checking modules are all of the same version”. That is another issue but has nothing to do with this issue!

The Question

Did I miss som crucial point in our preferred project setup? I would really like a discussion about the recommended way of organising bigger CDK apps/projects. This could hopefully lead to a new topic in developer guide.

@rix0rrr suggest a peerDependency solution for a similar problem here: https://github.com/aws/aws-cdk/commit/5e10b94aaaa87e6479e0bfcbe844d9fa68d0c1f5 but I fail to see how this would solve the problem. (please enlighten me if I missed something 😃 )

At the moment this is a show-stopper for our long-overdue upgrade of CDK

Reference

• https://github.com/aws/aws-cdk/issues/9546
• https://github.com/aws/aws-cdk/issues/10671
• https://github.com/gwriss/upgrade_bug

Environment

• CDK CLI Version: 1.68.0 (build a6a3f46)
• Module Version:
• Node.js Version: v12.19.0
• OS:
• Language (Version): TypeScript 3.9.7

Other information

[tobias-bardino]

I understand that CDK, as a project, does not want to fix the dependency problems with npm/lerna. Totally understandable.

Still, this will most likely become a problem lots of people will face in the future, when their CDK projects gets bigger and they need to rearrange their source code into separate projects.

@rix0rrr would it be interesting to have a section in the developer guide for organising bigger CDK projects? What is the best way to proceed with this?

[tobias-bardino]

https://github.com/aws/aws-cdk/pull/11113 will most likely fix this issue (still needs to be confirmed when CDK 1.72.0 is released)