Unable to install dbt 0.19.1 on M1 Apple Silicon and python 3.8.6

Describe the bug

While on a new apple silicon mac, the user can only install dbt 0.18.2. Attempting to upgrade using pip yields the following error message:

ERROR: Could not find a version that satisfies the requirement snowflake-connector-python[secure-local-storage]==2.3.6 (from dbt-snowflake)
ERROR: No matching distribution found for snowflake-connector-python[secure-local-storage]==2.3.6

Steps To Reproduce

pip install dbt installs 0.18.2.

Expected behavior

Install the latest version (0.19.1) of dbt

Screenshots and log output

See above

System information

Which database are you using dbt with?

• postgres
• redshift
• bigquery
• [x ] snowflake
• other (specify: ____________)

The output of dbt --version:

installed version: 0.18.2
   latest version: 0.19.1
Your version of dbt is out of date! You can find instructions for upgrading here:
https://docs.getdbt.com/docs/installation
Plugins:
  - bigquery: 0.18.2
  - snowflake: 0.18.2
  - redshift: 0.18.2
  - postgres: 0.18.2

The operating system you’re using: Mac OS Big Sur

The output of python --version: Python 3.8.6 pip 21.0.1

[drewbanin]

I had a tricky time getting dbt installed in my dev env using:

• Python 3.9
• macOS Big Sur
• an Apple silicon Mac

I tried running

pip install -r editable_requirements.txt

But i was seeing errors about the grpcio lib failing to install with an error about clang. I found this comment https://github.com/grpc/grpc/issues/24677#issuecomment-741814641 and ran:

GRPC_BUILD_WITH_BORING_SSL_ASM="" GRPC_PYTHON_BUILD_SYSTEM_OPENSSL=true GRPC_PYTHON_BUILD_SYSTEM_ZLIB=true pip install grpcio

And after that I was able to get dbt installed! Sharing in case it’s useful to anyone else 😃

[jtcohen6]

@jtalmi I believe this is because of the version of pyarrow required by snowflake-connector-python==2.3.6. I think the best workaround for the time being is to instal Rosetta, which should then let you install via pip or Homebrew in a py38 as if using an Intel chip.

This is definitely something we’re aware of (e.g. over in https://github.com/fishtown-analytics/dbt/issues/3162):

• Anyone not using Snowflake can install the latest version of their dbt adapter plugin on an M1 chip or in a py39 environment by specifying the adapter: pip install dbt-[adapter]
• Anyone using Snowflake: We’ve bumped the version of snowflake-connector-python in the develop branch, which should now be M1/py39 compatible. This issue will be resolved in the next version of dbt (v0.20.0). Sorry for the pain in the meantime!