hang with 100% cpu during preview of ConfigFile resources

Hello!

• Vote on this issue by adding a 👍 reaction
• To contribute a fix for this issue, leave a comment (and link to your pull request, if you’ve opened one already)

Issue details

Trying to pulumi up my prod environment after not touching it for a while, and it is hanging (100% cpu on python process) in preview. I believe is it related to the large (alb and cert-manager) k8s.yaml.ConfigFile resources I have. Everything has been fine for many months, but since the last time I touched it, pulumi, python, pulumi-kubernetes, and my laptop (new m1) have gone through many updates (which I have just applied). I’ve tried logging as suggested on the troubleshooting page, but can’t see anything interesting. pulumi refresh seems to work ok. aws cli and kubectl are connecting. If I comment out the ConfigFile resource, then preview completes normally (and offers to delete my resources).

$ pulumi version
v3.22.0

$ pip freeze
Arpeggio==1.10.2
attrs==21.4.0
certifi==2021.10.8
charset-normalizer==2.0.10
dill==0.3.4
grpcio==1.43.0
idna==3.3
parver==0.3.1
protobuf==3.19.3
pulumi==3.22.0
pulumi-aws==4.34.0
pulumi-eks==0.36.0
pulumi-kubernetes==3.14.0
PyYAML==6.0
requests==2.27.1
semver==2.13.0
six==1.16.0
urllib3==1.26.8```

[cbcmg]

So it was pretty simple in the end. The current protobuf python package does not build the extension for M1, and the pure python implementation either doesn’t work at all, or works too slowly with large chunks of yaml.

see: https://github.com/protocolbuffers/protobuf/issues/9839

Forcing the build of the local extension in the venv of my pulumi project resolves the issue.

A recipe for users with brew:

$ cd my-project
$ source venv/bin/activate
$ export CFLAGS="-I$(brew --prefix protobuf)/include"; export LDFLAGS="-L$(brew --prefix protobuf)/lib"
$ pip install --force-reinstall protobuf=="$(brew list --version protobuf | awk '{print $2}')" --install-option="--cpp_implementation"

[gabrielmccoll]

Yes, installing pulumi will install protobuf-3.20.1. Brew does not yet have that version, but 3.19.4 seems to work fine with pulumi.

Pulumi seemed to think the sdk wasn’t installed anymore

Not sure what happened there. If you have a clean pulumi project, brew installed, and protobuf installed with brew, and the script above completes without errors, it should work.

Okay got it thank you. I ran pip uninstall protobuf. then brew install protobuf then ran your script above and it seems to work now.

thanks a lot!