core: dep-graph creates invalid dependencies
See original GitHub issueCurrent Behavior
if project A
includes static import
or require
statement to another workspace project within a string (lets say project B
), nx will incorrectly resolve this as a dependency on that project, which leads to incorrect project graph creation
- thus running unnecessary packages on CI
- and also giving miss leading output when running
nx graph
.
UPDATE:
🎬 I was able to narrow down the AST parsing issue and the culprit is template string! whenever there is one being used and followed by string that includes static import then we run into wrong dependency tree resolution.
// @filename packages/proj-a/index.js
const npmScope = 'myorg';
// 🚨 this is the root cause - interpolating template literals
console.log(`@${npmScope}`);
// 🚨 now your project depends on proj-b ( which is not true )
console.log(`import {foo} from '@my-org/proj-b'`)
following will properly resolve the AST
// @filename packages/proj-a/index.js
const npmScope = 'myorg';
// ✅ no template strings, AST works
console.log('@' + npmScope);
// ✅ this will do no harm as expected
console.log(`import {foo} from '@my-org/proj-b'`)
Expected Behavior
dep-graph creation should ignore static import/require statements included as strings during AST parsing.
Steps to Reproduce
NOTE: download the project to try it out without hassle ast-issue-dep-graph.tar.gz
- remove cache `rm -rf node_modules/.cache/nx
- create 2 projects that contain following:
// @filename packages/proj-b/index.js
export const foo = 'hello'
// @filename packages/proj-a/index.js
const npmScope = 'myorg';
// 🚨 this is the root cause - interpolating template literals
console.log(`@${npmScope}`);
console.log(`import {foo} from '@my-org/proj-b'`);
export const moo = 'world'
- run following script:
// @filename repro.js
const { readCachedProjectGraph, createProjectGraphAsync } = require('@nrwl/workspace/src/core/project-graph');
main();
async function main() {
const graph = await createProjectGraphAsync()
console.log(
JSON.stringify({
nodes: graph.nodes['@my-org/proj-a'],
deps: graph.dependencies['@my-org/proj-a'],
}),
);
}
- this will result into following
node
definition:
{
"file": "packages/proj-a/index.js",
"hash": "15789608a71660844b9f5822cf3f2ed2c473ddf2",
"deps": ["@fluentui/proj-b"]
},
- this will result into following
dependencies
definition:
{ "source": "@my-org/proj-a", "target": "@my-org/proj-b", "type": "static" },
there should be no @my-org/proj-b
as a dependency
Failure Logs
Environment
Node : 14.18.1
OS : darwin x64
yarn : 1.23.34
nx : 13.8.1
@nrwl/angular : undefined
@nrwl/cli : 13.8.1
@nrwl/cypress : undefined
@nrwl/detox : undefined
@nrwl/devkit : 13.8.1
@nrwl/eslint-plugin-nx : undefined
@nrwl/express : undefined
@nrwl/jest : 13.8.1
@nrwl/js : 13.8.1
@nrwl/linter : 13.8.1
@nrwl/nest : undefined
@nrwl/next : undefined
@nrwl/node : 13.8.1
@nrwl/nx-cloud : undefined
@nrwl/react : undefined
@nrwl/react-native : undefined
@nrwl/schematics : undefined
@nrwl/storybook : undefined
@nrwl/tao : 13.8.1
@nrwl/web : undefined
@nrwl/workspace : 13.8.1
typescript : 4.3.5
rxjs : 6.6.7
Issue Analytics
- State:
- Created 2 years ago
- Reactions:1
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Source code for speechbrain.utils.depgraph
"""A dependency graph for finding evaluation order. ... before A" Nodes can be added explicitly or they can be created implicitly while adding...
Read more >Snyk for Bazel - Snyk User Docs
The Snyk Dep Graph Test API takes a generic dependency graph, and returns a report containing any relevant vulnerabilities for those dependencies.
Read more >Official - Experimental Dependency Viewer - Unity Forum
There are some good packages on the Asset Store offering this kind of functionality but it would be better if it was part...
Read more >How to fail a project if dependencies are invalid - Stack Overflow
I looked into the code: The warning happens in maven-core because of an EventType.ARTIFACT_DESCRIPTOR_INVALID. In the ...
Read more >What I was doing wrong — dependency management and ...
Supporting multiple dependencies in a distributed architecture is a ... efforts to support dependency management when core layers are not ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Yes, I’m pretty sure this is due to the underlying issue of these bugs: https://github.com/microsoft/TypeScript/issues/47597 https://github.com/microsoft/TypeScript/issues/30878
For some reason, the
Scanner
fromtypescript
, does not identify the right tokens for this syntax. I tried to work around it but wasn’t successful.For your file specifically, I would suggest perhaps using a snapshot? Nx won’t analyze those files for dependencies.
This issue has been automatically marked as stale because it hasn’t had any recent activity. It will be closed in 14 days if no further activity occurs. If we missed this issue please reply to keep it active. Thanks for being a part of the Nx community! 🙏