dask-ec2 security group VPC error

I’m getting a Amazon VPC security error when I try to run dask-ec2 up. I followed the directions in http://distributed.readthedocs.io/en/latest/ec2.html exactly. If I run the dask-ec2 up a second time it successfully starts images, but the ssh step fails. I’m guessing this is an EC2 permissions problem…

Thanks, Nick

MyMac$ dask-ec2 up --keyname aws_key_pair --keypair ~/.ssh/aws_key_pair.pem 
Launching nodes
DEBUG: Checking that keyname 'aws_key_pair' exists on EC2
DEBUG: Checking that security group 'dask-ec2-default' exists on EC2
DEBUG: Default security group 'dask-ec2-default' not found, creating it
DEBUG: Creating default (very open) security group 'dask-ec2-default'
DEBUG: Setting up default values for the 'dask-ec2-default' security group
Unexpected EC2 error: An error occurred (InvalidParameterValue) when calling the AuthorizeSecurityGroupEgress operation: Only Amazon VPC security groups may be used with this operation.

[ngcrawford]

Letting the script run longer fixed my issue. Thanks for your help Daniel.

[danielfrg]

Yes, unfortunately dask-ec2 only uses whatever its the default for the AWS account even when you create a default VPC. There is an issue to track that here: https://github.com/dask/dask-ec2/issues/17

Since you changed region i think it should work. On this case the error I see is different. Those ssh errors are “expected” since the EC2 instance state is running but SSH is not available immediately and there is no event from AWS to tell us that. So we have to poll and retry a couple of times. If you let that command run it should connect eventually and start the bootstrap process.