RuntimeError: Unsupported platform
See original GitHub issueHi, I am trying to run the examples in the provided docker image, I get this error:
user@user-G3-3500:/workspace/code/AITemplate/examples$ python3.8 01_resnet-50/benchmark_pt.py Traceback (most recent call last): File "01_resnet-50/benchmark_pt.py", line 20, in <module> from aitemplate.testing.benchmark_pt import benchmark_torch_function File "/usr/local/lib/python3.8/dist-packages/aitemplate/__init__.py", line 19, in <module> from . import backend, compiler, frontend, testing, utils File "/usr/local/lib/python3.8/dist-packages/aitemplate/frontend/__init__.py", line 16, in <module> from . import nn File "/usr/local/lib/python3.8/dist-packages/aitemplate/frontend/nn/__init__.py", line 17, in <module> from .embedding import BertEmbeddings, Embedding File "/usr/local/lib/python3.8/dist-packages/aitemplate/frontend/nn/embedding.py", line 38, in <module> USE_CUDA = detect_target().name() == "cuda" File "/usr/local/lib/python3.8/dist-packages/aitemplate/testing/detect_target.py", line 97, in detect_target raise RuntimeError("Unsupported platform") RuntimeError: Unsupported platform
My GPU info: GeForce RTX 2060 Nvidia-smi in host machine: ` ±----------------------------------------------------------------------------+ | NVIDIA-SMI 520.61.05 Driver Version: 520.61.05 CUDA Version: 11.8 | |-------------------------------±---------------------±---------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 NVIDIA GeForce … Off | 00000000:01:00.0 Off | N/A | | N/A 56C P0 14W / N/A | 10MiB / 6144MiB | 0% Default | | | | N/A | ±------------------------------±---------------------±---------------------+
±----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 1700 G /usr/lib/xorg/Xorg 4MiB | | 0 N/A N/A 2352 G /usr/lib/xorg/Xorg 4MiB | ±----------------------------------------------------------------------------+ `
nvcc in host machine:
Cuda compilation tools, release 11.8, V11.8.89 Build cuda_11.8.r11.8/compiler.31833905_0
nvcc in docker machine:
Cuda compilation tools, release 11.6, V11.6.124 Build cuda_11.6.r11.6/compiler.31057947_0
Issue Analytics
- State:
- Created a year ago
- Comments:5 (2 by maintainers)
Top GitHub Comments
Hardware requirement:
NVIDIA: AIT is only tested on SM80+ GPUs (Ampere etc). Not all kernels work with old SM75/SM70 (T4/V100) GPUs.
We currently disabled non Ampere gpu. 2080 is a SM75 GPU iirc, not all kernels are supported on the old gpus.
@antinucleon Hi Bing, do you have a plan to update these checks? I have Nvidia A40 on my servers, which cannot pass this test (though I believe it is Ampere), so that I have to build AITemplate from source instead of using your prebuild dockers.